Nov 06 21:09:14 devstack cinder-volume[76189]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:09:14 devstack cinder-volume[76189]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:09:14 devstack cinder-volume[76189]: we strongly recommend against using it for new projects. Nov 06 21:09:14 devstack cinder-volume[76189]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:09:14 devstack cinder-volume[76189]: framework. For more detail see Nov 06 21:09:14 devstack cinder-volume[76189]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:09:14 devstack cinder-volume[76189]: import eventlet # noqa Nov 06 21:09:16 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:09:16 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:09:16 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:09:17 devstack cinder-volume[76189]: INFO dbcounter [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Registered counter for database cinder Nov 06 21:09:17 devstack cinder-volume[76189]: DEBUG oslo_db.sqlalchemy.engines [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:17 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writer thread running {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:09:17 devstack cinder-volume[76189]: INFO cinder.rpc [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:09:17 devstack cinder-volume[76189]: INFO cinder.rpc [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:09:17 devstack cinder-volume[76189]: DEBUG oslo_db.sqlalchemy.engines [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:18 devstack cinder-volume[76189]: INFO cinder.volume.manager [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Determined volume DB was empty at startup. Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG cinder.volume.manager [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76189) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 21:09:18 devstack cinder-volume[76189]: INFO cinder.volume.manager [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:09:18 devstack cinder-volume[76189]: WARNING stevedore.named [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:09:18 devstack cinder-volume[76189]: WARNING castellan.key_manager [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:09:18 devstack cinder-volume[76189]: WARNING cinder.keymgr.conf_key_mgr [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG cinder.volume.drivers.lvm [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76189) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] CMD "cinder-rtstool verify" returned: 0 in 0.427s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_db.sqlalchemy.engines [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:18 devstack cinder-volume[76189]: INFO cinder.rpc [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 21:09:18 devstack cinder-volume[76189]: INFO cinder.rpc [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 21:09:18 devstack cinder-volume[76189]: WARNING stevedore.named [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:09:18 devstack cinder-volume[76189]: WARNING castellan.key_manager [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:09:18 devstack cinder-volume[76189]: INFO cinder.volume.manager [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_db.sqlalchemy.engines [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:18 devstack cinder-volume[76189]: INFO oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Starting 1 workers Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Started child 76335 {{(pid=76189) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Full set of CONF: {{(pid=76189) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] ******************************************************************************** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Configuration options gathered from: {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] ================================================================================ {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] allow_availability_zone_fallback = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] allow_compression_on_image_upload = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76335]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] allowed_direct_url_schemes = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] api_rate_limit = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] auth_strategy = keystone {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] az_cache_duration = 3600 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_availability_zone = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_host = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_stats_polling_interval = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backup_api_class = cinder.backup.api.API {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backup_name_template = backup-%s {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backup_use_same_host = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backup_use_temp_snapshot = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] chap_password = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] chap_username = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_internal_tenant_project_id = c0ff76ec524e4215aa05ef86f1cede08 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_internal_tenant_user_id = 4d4839d02b2742aeb82207275fff9132 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cloned_volume_same_az = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cluster = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] compression_format = gzip {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] compute_api_class = cinder.compute.nova.API {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] config_dir = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] config_source = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] control_exchange = openstack {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] debug = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] default_availability_zone = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] default_group_type = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] default_volume_type = lvmdriver-1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] disk_geometry = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] driver_client_cert = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] driver_client_cert_key = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] driver_data_namespace = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] driver_ssl_cert_path = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] driver_ssl_cert_verify = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] driver_use_ssl = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] enable_force_upload = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] enable_new_services = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76335]: INFO cinder.volume.manager [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 21:09:18 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] enable_unsupported_driver = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] enforce_multipath_for_image_xfer = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] filter_function = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_api_insecure = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_api_ssl_compression = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_ca_certificates_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_catalog_info = image:glance:publicURL {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_num_retries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance_request_timeout = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] goodness_function = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] graceful_shutdown_timeout = 5 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] group_api_class = cinder.group.api.API {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] host = devstack {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_compress_on_upload = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_conversion_address_space_limit = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_conversion_cpu_limit = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_conversion_disable = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_introspection_address_space_limit = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_introspection_cpu_limit = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_upload_use_cinder_backend = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_upload_use_internal_tenant = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:18 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_volume_cache_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_volume_cache_max_count = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] image_volume_cache_max_size_gb = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] init_host_max_objects_retrieval = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] instance_format = [instance: %(uuid)s] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] iscsi_target_flags = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] iscsi_write_cache = on {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] iser_helper = tgtadm {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] iser_ip_address = 192.168.122.192 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] iser_port = 3260 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_color = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_config_append = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_dir = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_options = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_rotate_interval = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_rotate_interval_type = days {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] log_rotation_type = none {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] max_age = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] max_logfile_count = 30 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] max_logfile_size_mb = 200 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] max_over_subscription_ratio = 20.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] message_reap_interval = 86400 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] message_ttl = 2592000 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] migration_create_volume_timeout_secs = 300 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] monkey_patch = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] monkey_patch_modules = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] my_ip = 192.168.122.192 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] no_snapshot_gb_quota = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] num_iser_scan_tries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] num_shell_tries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] num_volume_device_scan_tries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:18 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] nvmeof_conn_info_version = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] nvmet_ns_id = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] nvmet_port_id = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] osapi_max_limit = 1000 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] osapi_volume_ext_list = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] osapi_volume_listen_port = 8776 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] osapi_volume_use_ssl = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] osapi_volume_workers = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] per_volume_size_limit = -1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] periodic_fuzzy_delay = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] periodic_interval = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] public_endpoint = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] publish_errors = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] quota_backup_gigabytes = 1000 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] quota_backups = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] quota_gigabytes = 1000 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] quota_groups = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] quota_snapshots = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack sudo[76340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 21:09:18 devstack sudo[76340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] quota_volumes = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] rate_limit_burst = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] rate_limit_except_level = CRITICAL {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] rate_limit_interval = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] reinit_driver_count = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] replication_device = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] report_discard_supported = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] report_interval = 120 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] reservation_clean_interval = 86400 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] reservation_expire = 86400 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] reserved_image_namespaces = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] reserved_percentage = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] rpc_response_timeout = 120 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] run_external_periodic_tasks = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] scst_target_driver = iscsi {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] scst_target_iqn_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_down_time = 720 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] shell_completion = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] snapshot_name_template = snapshot-%s {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] snapshot_same_host = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] split_loggers = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] state_path = /opt/stack/data/cinder {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] storage_availability_zone = nova {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] storage_protocol = iSCSI {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] syslog_log_facility = LOG_USER {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] target_helper = lioadm {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] target_ip_address = 192.168.122.192 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] target_port = 3260 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] target_protocol = iscsi {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] target_secondary_ip_addresses = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] trace_flags = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] transport_url = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] until_refresh = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] use_chap_auth = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] use_default_quota_class = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] use_journal = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] use_json = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] use_multipath_for_image_xfer = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] use_stderr = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] use_syslog = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] verify_glance_signatures = enabled {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_api_class = cinder.volume.api.API {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_backend_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_clear = zero {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_clear_ionice = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_clear_size = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_copy_bps_limit = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_dd_blocksize = 1M {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_name_template = volume-%s {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_service_inithost_offload = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volume_usage_audit_period = month {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] zoning_mode = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_concurrency.disable_process_locking = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.auth_section = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.auth_type = password {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.auth_version = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.cache = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.include_service_catalog = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.insecure = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.interface = public {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_password = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcache_username = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.region_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.service_type = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.backend = dogpile.cache.null {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.backend_argument = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.backend_expiration_time = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.config_prefix = cache.oslo {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.debug_cache_backend = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.enable_retry_client = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.enable_socket_keepalive = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.expiration_time = 600 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.hashclient_retry_attempts = 2 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.memcache_dead_retry = 300 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.memcache_pool_maxsize = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.memcache_sasl_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.password = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.proxies = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.redis_db = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.redis_server = localhost:6379 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.retry_attempts = 2 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.retry_delay = 0.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.socket_keepalive_count = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:18 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.socket_keepalive_idle = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.socket_keepalive_interval = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.socket_timeout = 1.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.tls_allowed_ciphers = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.tls_cafile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.tls_certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.tls_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.tls_keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cache.username = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] coordination.backend_url = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.asyncio_connection = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.asyncio_slave_connection = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.backend = sqlalchemy {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.connection = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.connection_debug = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.connection_parameters = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.connection_recycle_time = 3600 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.connection_trace = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.db_inc_retry_interval = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.db_max_retries = 20 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.db_max_retry_interval = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.db_retry_interval = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.max_overflow = 50 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.max_pool_size = 5 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.max_retries = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.mysql_wsrep_sync_wait = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.pool_timeout = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.retry_interval = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.slave_connection = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.sqlite_synchronous = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.synchronous_reader = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] database.use_db_reconnect = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_tracing.insecure = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.connection_string = messaging:// {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.es_doc_type = notification {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.es_scroll_size = 10000 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.es_scroll_time = 2m {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.filter_error_trace = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.hmac_keys = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.sentinel_service_name = mymaster {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.socket_timeout = 0.1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.trace_requests = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler.trace_sqlalchemy = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler_jaeger.process_tags = {} {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler_jaeger.service_name_prefix = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] profiler_otlp.service_name_prefix = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.enforce_new_defaults = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.policy_default_rule = default {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.policy_file = policy.yaml {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] privsep_osbrick.group = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] privsep_osbrick.helper_command = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] privsep_osbrick.user = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_sys_admin.group = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_sys_admin.helper_command = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] cinder_sys_admin.user = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.auth_section = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.auth_type = password {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.cafile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.collect_timing = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.insecure = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.send_service_user_token = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.split_loggers = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.timeout = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.tls_ciphers = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] service_user.tls_min_version = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.auth_section = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.auth_type = password {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.collect_timing = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.insecure = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.region_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.split_loggers = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.timeout = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.tls_ciphers = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] glance.tls_min_version = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.backend_availability_zone = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.chap_password = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.chap_username = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.disk_geometry = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.driver_client_cert = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.driver_client_cert_key = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.driver_data_namespace = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.driver_use_ssl = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.extra_capabilities = {} {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.filter_function = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.goodness_function = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.iscsi_target_flags = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.iscsi_write_cache = on {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.iser_helper = tgtadm {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.iser_port = 3260 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.lvm_share_target = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.lvm_type = auto {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.num_shell_tries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.replication_device = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.report_discard_supported = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.reserved_percentage = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.target_helper = tgtadm {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.target_port = 3260 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.target_protocol = iscsi {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.trace_flags = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.unique_fqdn_network = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.use_chap_auth = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_backend_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_clear = zero {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_clear_ionice = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_clear_size = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_reports.file_event_handler = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_reports.log_dir = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.backend_host = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.chap_password = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.chap_username = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.disk_geometry = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.driver_client_cert = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.extra_capabilities = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.filter_function = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.goodness_function = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.iser_helper = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.iser_ip_address = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.iser_port = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.lvm_share_target = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.lvm_type = auto {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.num_shell_tries = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.replication_device = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.report_discard_supported = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.reserved_percentage = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.scst_target_driver = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.storage_protocol = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.target_helper = lioadm {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.target_ip_address = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.target_port = 3260 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.trace_flags = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.use_chap_auth = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_clear = zero {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_clear_size = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] lvmdriver-1.volumes_dir = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.ssl = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_notifications.driver = [] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_notifications.retry = -1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] key_manager.fixed_key = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.barbican_api_version = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.barbican_endpoint = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.barbican_endpoint_type = public {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.barbican_region_name = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.cafile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.collect_timing = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.insecure = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.number_of_retries = 60 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.retry_delay = 1 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.send_service_user_token = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.split_loggers = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.timeout = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.tls_ciphers = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.tls_min_version = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.verify_ssl = True {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican.verify_ssl_path = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.auth_section = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.auth_type = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.cafile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.certfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.collect_timing = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.insecure = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.keyfile = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.split_loggers = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.timeout = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.tls_ciphers = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] barbican_service_user.tls_min_version = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.approle_role_id = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.approle_secret_id = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.auth_method = approle {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.auth_path = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.kv_mountpoint = secret {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.kv_path = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.kv_version = 2 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.namespace = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.root_token_id = **** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.ssl_ca_crt_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.timeout = 60.0 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.token_file = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.token_role = None {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.use_ssl = False {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:19 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] ******************************************************************************** {{(pid=76189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:09:19 devstack sudo[76340]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:19 devstack sudo[76345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:19 devstack sudo[76345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:19 devstack sudo[76345]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.349s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:09:19 devstack cinder-volume[76335]: INFO cinder.brick.local_dev.lvm [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:19 devstack sudo[76461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:19 devstack sudo[76461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:19 devstack sudo[76461]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG cinder.brick.local_dev.lvm [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76335) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 21:09:19 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:19 devstack sudo[76552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:19 devstack sudo[76552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:20 devstack sudo[76552]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:20 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:20 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:20 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:20 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:20 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 21:09:20 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:21 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:21 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.310s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:21 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:21 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:21 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:21 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:21 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:21 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:21 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:21 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:21 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:21 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:21 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:21 devstack sudo[77044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:21 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:22 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:22 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:22 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:22 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:22 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:22 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:22 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:22 devstack cinder-volume[76335]: INFO cinder.volume.drivers.lvm [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:22 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:22 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:22 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG cinder.volume.drivers.lvm [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Updating volume stats {{(pid=76335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:09:22 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:22 devstack sudo[77144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:22 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:23 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:23 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:23 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:23 devstack sudo[77153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:23 devstack sudo[77153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:23 devstack sudo[77153]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:23 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:23 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:23 devstack sudo[77156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:23 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:23 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:23 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:23 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:23 devstack sudo[77160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:23 devstack sudo[77160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:24 devstack sudo[77160]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:24 devstack cinder-volume[76335]: INFO cinder.volume.driver [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG cinder.volume.driver [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76335) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG oslo_db.sqlalchemy.engines [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG dbcounter [-] [76335] Writer thread running {{(pid=76335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG cinder.db.api [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Building query based on filter {{(pid=76335) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG cinder.image.image_utils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76335) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:09:24 devstack cinder-volume[76335]: INFO cinder.keymgr.migration [None req-3f37a016-d03a-462e-8c09-5d6d3da5eb64 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG cinder.volume.drivers.lvm [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Updating volume stats {{(pid=76335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:24 devstack sudo[77164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:24 devstack sudo[77164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:24 devstack sudo[77164]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:24 devstack sudo[77168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:24 devstack sudo[77168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:24 devstack sudo[77168]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:24 devstack sudo[77173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:24 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:25 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:25 devstack sudo[77176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:25 devstack sudo[77176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:25 devstack sudo[77176]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG cinder.manager [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Notifying Schedulers of capabilities ... {{(pid=76335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:09:25 devstack cinder-volume[76335]: INFO cinder.volume.manager [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Driver initialization completed successfully. Nov 06 21:09:25 devstack cinder-volume[76335]: INFO cinder.manager [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Initiating service 2 cleanup Nov 06 21:09:25 devstack cinder-volume[76335]: INFO cinder.manager [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Service 2 cleanup completed. Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG cinder.service [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Creating RPC server for service cinder-volume {{(pid=76335) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG cinder.service [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76335) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:09:25 devstack cinder-volume[76335]: INFO cinder.volume.manager [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG cinder.volume.drivers.lvm [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Updating volume stats {{(pid=76335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:25 devstack sudo[77179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:25 devstack sudo[77179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:25 devstack sudo[77179]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:25 devstack sudo[77183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:25 devstack sudo[77183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:26 devstack sudo[77183]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:26 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:26 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:26 devstack sudo[77187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:26 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:26 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:26 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:26 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:26 devstack sudo[77190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:26 devstack sudo[77190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:26 devstack sudo[77190]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:26 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:26 devstack cinder-volume[76335]: INFO cinder.volume.manager [None req-6830ad7f-39be-45f6-ad03-72ab5ea744fb None None] Driver post RPC initialization completed successfully. Nov 06 21:09:28 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:09:36 devstack cinder-volume[76335]: DEBUG dbcounter [-] [76335] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:09:36 devstack cinder-volume[76335]: DEBUG dbcounter [-] [76335] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:10:24 devstack cinder-volume[76335]: DEBUG oslo_service.periodic_task [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:10:24 devstack cinder-volume[76335]: DEBUG cinder.volume.drivers.lvm [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Updating volume stats {{(pid=76335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:10:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:24 devstack sudo[79109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:10:24 devstack sudo[79109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:24 devstack sudo[79109]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:24 devstack sudo[79112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:10:24 devstack sudo[79112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:25 devstack sudo[79112]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:25 devstack sudo[79115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:10:25 devstack sudo[79115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:25 devstack sudo[79115]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:25 devstack sudo[79118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:10:25 devstack sudo[79118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:25 devstack sudo[79118]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG cinder.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Notifying Schedulers of capabilities ... {{(pid=76335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG oslo_service.periodic_task [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running periodic task VolumeManager._thread_info {{(pid=76335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG cinder.volume.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] thread count: 6 {{(pid=76335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:10:25 devstack cinder-volume[76335]: DEBUG cinder.volume.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] thread info: [<_MainThread(MainThread, started 133859514544256)>, , , , , ] {{(pid=76335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:11:24 devstack cinder-volume[76335]: DEBUG oslo_service.periodic_task [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:11:24 devstack cinder-volume[76335]: DEBUG cinder.volume.drivers.lvm [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Updating volume stats {{(pid=76335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:11:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:24 devstack sudo[82454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:11:24 devstack sudo[82454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:24 devstack sudo[82454]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:24 devstack sudo[82462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:11:24 devstack sudo[82462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:25 devstack sudo[82462]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:25 devstack sudo[82470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:11:25 devstack sudo[82470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:25 devstack sudo[82470]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:25 devstack sudo[82474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:11:25 devstack sudo[82474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:25 devstack sudo[82474]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG cinder.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Notifying Schedulers of capabilities ... {{(pid=76335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG oslo_service.periodic_task [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running periodic task VolumeManager._thread_info {{(pid=76335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG cinder.volume.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] thread count: 6 {{(pid=76335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:11:25 devstack cinder-volume[76335]: DEBUG cinder.volume.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] thread info: [<_MainThread(MainThread, started 133859514544256)>, , , , , ] {{(pid=76335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:11:36 devstack cinder-volume[76335]: DEBUG dbcounter [-] [76335] Writing DB stats cinder:SELECT=1 {{(pid=76335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:11:36 devstack cinder-volume[76335]: DEBUG dbcounter [-] [76335] Writing DB stats cinder:UPDATE=1 {{(pid=76335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:12:24 devstack cinder-volume[76335]: DEBUG oslo_service.periodic_task [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:12:24 devstack cinder-volume[76335]: DEBUG cinder.volume.drivers.lvm [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Updating volume stats {{(pid=76335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:12:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:24 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:12:24 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:24 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:24 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:12:24 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:25 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:25 devstack sudo[84536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:12:25 devstack sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:25 devstack sudo[84536]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:25 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:12:25 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:25 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:25 devstack cinder-volume[76335]: DEBUG cinder.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Notifying Schedulers of capabilities ... {{(pid=76335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:13:24 devstack cinder-volume[76335]: DEBUG oslo_service.periodic_task [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:13:24 devstack cinder-volume[76335]: DEBUG cinder.volume.drivers.lvm [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Updating volume stats {{(pid=76335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:13:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:24 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:13:24 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:24 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:24 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:24 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:13:24 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:25 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:25 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:13:25 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:25 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:25 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:13:25 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:25 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG oslo_concurrency.processutils [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG cinder.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Notifying Schedulers of capabilities ... {{(pid=76335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG oslo_service.periodic_task [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] Running periodic task VolumeManager._thread_info {{(pid=76335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG cinder.volume.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] thread count: 6 {{(pid=76335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:13:25 devstack cinder-volume[76335]: DEBUG cinder.volume.manager [None req-80f9d322-2240-4f3a-b68c-dee5d5271121 None None] thread info: [<_MainThread(MainThread, started 133859514544256)>, , , , , ] {{(pid=76335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:13:36 devstack cinder-volume[76335]: DEBUG dbcounter [-] [76335] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:13:53 devstack cinder-volume[76189]: INFO oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Caught SIGTERM, stopping children Nov 06 21:13:53 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Acquiring lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:13:53 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Acquired lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:13:53 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Releasing lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:13:53 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Stop services. {{(pid=76189) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:13:53 devstack cinder-volume[76189]: DEBUG oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Killing children. {{(pid=76189) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:13:53 devstack cinder-volume[76189]: INFO oslo_service.backend._eventlet.service [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Waiting on 1 children to exit Nov 06 21:13:58 devstack cinder-volume[76335]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 06 21:13:58 devstack cinder-volume[86418]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:13:58 devstack cinder-volume[86418]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:13:58 devstack cinder-volume[86418]: we strongly recommend against using it for new projects. Nov 06 21:13:58 devstack cinder-volume[86418]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:13:58 devstack cinder-volume[86418]: framework. For more detail see Nov 06 21:13:58 devstack cinder-volume[86418]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:13:58 devstack cinder-volume[86418]: import eventlet # noqa Nov 06 21:14:00 devstack cinder-volume[76335]: DEBUG oslo_concurrency.lockutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Acquiring lock "singleton_lock" {{(pid=76335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:00 devstack cinder-volume[76335]: DEBUG oslo_concurrency.lockutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Acquired lock "singleton_lock" {{(pid=76335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:00 devstack cinder-volume[76335]: DEBUG oslo_concurrency.lockutils [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Releasing lock "singleton_lock" {{(pid=76335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:00 devstack cinder-volume[76335]: WARNING amqp [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:14:00 devstack cinder-volume[76335]: WARNING amqp [None req-c014c905-ea97-4fab-a5db-4a510dccbc97 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:14:00 devstack cinder-volume[86418]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:00 devstack cinder-volume[86418]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:00 devstack cinder-volume[86418]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:01 devstack cinder-volume[86418]: INFO dbcounter [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Registered counter for database cinder Nov 06 21:14:01 devstack cinder-volume[86418]: DEBUG oslo_db.sqlalchemy.engines [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86418) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:01 devstack cinder-volume[86418]: DEBUG dbcounter [-] [86418] Writer thread running {{(pid=86418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:01 devstack cinder-volume[86418]: INFO cinder.rpc [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:14:01 devstack cinder-volume[86418]: INFO cinder.rpc [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_db.sqlalchemy.engines [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86418) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:02 devstack cinder-volume[86418]: INFO cinder.volume.manager [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Determined volume DB was empty at startup. Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG cinder.volume.manager [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86418) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 21:14:02 devstack cinder-volume[86418]: INFO cinder.volume.manager [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:14:02 devstack cinder-volume[86418]: WARNING stevedore.named [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:14:02 devstack cinder-volume[86418]: WARNING castellan.key_manager [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:02 devstack cinder-volume[86418]: WARNING cinder.keymgr.conf_key_mgr [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:02 devstack cinder-volume[86418]: INFO cinder.volume.manager [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_db.sqlalchemy.engines [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86418) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:02 devstack cinder-volume[86418]: INFO oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Starting 1 workers Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Started child 86642 {{(pid=86418) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Full set of CONF: {{(pid=86418) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] ******************************************************************************** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Configuration options gathered from: {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] ================================================================================ {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] allow_availability_zone_fallback = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] allow_compression_on_image_upload = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] allowed_direct_url_schemes = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] api_rate_limit = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] auth_strategy = keystone {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_availability_zone = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_host = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86642]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_stats_polling_interval = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backup_api_class = cinder.backup.api.API {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backup_name_template = backup-%s {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backup_use_same_host = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backup_use_temp_snapshot = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] chap_password = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] chap_username = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_internal_tenant_project_id = c0ff76ec524e4215aa05ef86f1cede08 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_internal_tenant_user_id = 4d4839d02b2742aeb82207275fff9132 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cluster = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] compression_format = gzip {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] compute_api_class = cinder.compute.nova.API {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] config_dir = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] config_source = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] control_exchange = openstack {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] debug = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] default_availability_zone = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] default_group_type = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] default_volume_type = QuobyteHD {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] disk_geometry = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] driver_client_cert = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] driver_client_cert_key = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] driver_data_namespace = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] driver_ssl_cert_path = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] driver_ssl_cert_verify = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] driver_use_ssl = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] enable_new_services = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] enable_unsupported_driver = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] enabled_backends = ['QuobyteHD'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] enforce_multipath_for_image_xfer = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] filter_function = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_api_insecure = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_api_ssl_compression = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_ca_certificates_file = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_catalog_info = image:glance:publicURL {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_num_retries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance_request_timeout = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] goodness_function = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] graceful_shutdown_timeout = 5 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] group_api_class = cinder.group.api.API {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] host = devstack {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_compress_on_upload = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_conversion_address_space_limit = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_conversion_cpu_limit = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_conversion_disable = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_introspection_address_space_limit = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_introspection_cpu_limit = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_upload_use_cinder_backend = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_upload_use_internal_tenant = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_volume_cache_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_volume_cache_max_count = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] image_volume_cache_max_size_gb = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] init_host_max_objects_retrieval = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] instance_format = [instance: %(uuid)s] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] iscsi_target_flags = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] iscsi_write_cache = on {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] iser_helper = tgtadm {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] iser_ip_address = 192.168.122.192 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] iser_port = 3260 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_color = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_config_append = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_dir = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_file = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_options = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_rotate_interval = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_rotate_interval_type = days {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] log_rotation_type = none {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] max_age = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] max_logfile_count = 30 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] max_logfile_size_mb = 200 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86642]: INFO cinder.volume.manager [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] max_over_subscription_ratio = 20.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] message_reap_interval = 86400 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] message_ttl = 2592000 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] migration_create_volume_timeout_secs = 300 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] monkey_patch = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.remotefs [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86642) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] monkey_patch_modules = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] my_ip = 192.168.122.192 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] no_snapshot_gb_quota = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] num_iser_scan_tries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] num_shell_tries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] num_volume_device_scan_tries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] nvmeof_conn_info_version = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] nvmet_ns_id = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] nvmet_port_id = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] osapi_max_limit = 1000 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] osapi_volume_ext_list = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] osapi_volume_listen_port = 8776 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] osapi_volume_use_ssl = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] osapi_volume_workers = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] per_volume_size_limit = -1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] periodic_fuzzy_delay = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] periodic_interval = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] public_endpoint = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] publish_errors = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] quota_backup_gigabytes = 1000 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] quota_backups = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] quota_gigabytes = 1000 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] quota_groups = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] quota_snapshots = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] quota_volumes = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] rate_limit_burst = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] rate_limit_except_level = CRITICAL {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] rate_limit_interval = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] reinit_driver_count = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] replication_device = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] report_discard_supported = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] report_interval = 120 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] reservation_clean_interval = 86400 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] reservation_expire = 86400 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] reserved_image_namespaces = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] reserved_percentage = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] rpc_response_timeout = 120 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] run_external_periodic_tasks = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] scst_target_driver = iscsi {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] scst_target_iqn_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_down_time = 720 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] shell_completion = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] snapshot_name_template = snapshot-%s {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] split_loggers = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] state_path = /opt/stack/data/cinder {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] storage_availability_zone = nova {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] storage_protocol = iSCSI {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] syslog_log_facility = LOG_USER {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] target_helper = lioadm {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] target_ip_address = 192.168.122.192 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] target_port = 3260 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] target_protocol = iscsi {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] target_secondary_ip_addresses = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] trace_flags = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] transport_url = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] until_refresh = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] use_chap_auth = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] use_default_quota_class = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] use_journal = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] use_json = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] use_multipath_for_image_xfer = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] use_stderr = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] use_syslog = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] verify_glance_signatures = enabled {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_api_class = cinder.volume.api.API {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_backend_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_clear = zero {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_clear_ionice = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_clear_size = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_copy_bps_limit = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_dd_blocksize = 1M {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_name_template = volume-%s {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_service_inithost_offload = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volume_usage_audit_period = month {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] zoning_mode = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_concurrency.disable_process_locking = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.auth_section = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.auth_type = password {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.auth_version = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.cache = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.include_service_catalog = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.insecure = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.interface = public {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_password = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86642) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:14:02 devstack cinder-volume[86642]: WARNING cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:14:02 devstack cinder-volume[86642]: WARNING cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Running cmd (subprocess): mount.quobyte {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcache_username = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.region_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.service_type = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.backend = dogpile.cache.null {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.backend_argument = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.backend_expiration_time = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.config_prefix = cache.oslo {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.debug_cache_backend = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.enable_retry_client = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.enable_socket_keepalive = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.expiration_time = 600 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.hashclient_retry_attempts = 2 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.memcache_dead_retry = 300 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.memcache_pool_maxsize = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.memcache_sasl_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.password = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.proxies = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.redis_db = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.redis_server = localhost:6379 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.retry_attempts = 2 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.retry_delay = 0.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.socket_keepalive_count = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.socket_keepalive_idle = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.socket_keepalive_interval = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.socket_timeout = 1.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.tls_allowed_ciphers = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.tls_cafile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.tls_certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.tls_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.tls_keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cache.username = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] coordination.backend_url = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.asyncio_connection = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.asyncio_slave_connection = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.backend = sqlalchemy {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.connection = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.connection_debug = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.connection_parameters = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.connection_recycle_time = 3600 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.connection_trace = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.db_inc_retry_interval = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.db_max_retries = 20 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.db_max_retry_interval = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.db_retry_interval = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.max_overflow = 50 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.max_pool_size = 5 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.max_retries = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.mysql_wsrep_sync_wait = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.pool_timeout = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.retry_interval = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.slave_connection = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.sqlite_synchronous = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.synchronous_reader = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] database.use_db_reconnect = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_tracing.insecure = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.connection_string = messaging:// {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.es_doc_type = notification {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.es_scroll_size = 10000 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.es_scroll_time = 2m {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.filter_error_trace = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.hmac_keys = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.sentinel_service_name = mymaster {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.socket_timeout = 0.1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.trace_requests = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler.trace_sqlalchemy = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler_jaeger.process_tags = {} {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler_jaeger.service_name_prefix = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] profiler_otlp.service_name_prefix = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.enforce_new_defaults = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.policy_default_rule = default {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.policy_file = policy.yaml {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] privsep_osbrick.group = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] privsep_osbrick.helper_command = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] privsep_osbrick.user = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_sys_admin.group = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_sys_admin.helper_command = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] cinder_sys_admin.user = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.auth_section = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.auth_type = password {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.cafile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.collect_timing = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.insecure = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.send_service_user_token = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.split_loggers = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.timeout = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.tls_ciphers = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] service_user.tls_min_version = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.auth_section = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.auth_type = password {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.collect_timing = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.insecure = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.region_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.split_loggers = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.timeout = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.tls_ciphers = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] glance.tls_min_version = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.backend_availability_zone = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.chap_password = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.chap_username = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.disk_geometry = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.driver_client_cert = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.driver_client_cert_key = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.driver_data_namespace = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.driver_use_ssl = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.extra_capabilities = {} {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.filter_function = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.goodness_function = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.iscsi_target_flags = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.iscsi_write_cache = on {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.iser_helper = tgtadm {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.iser_port = 3260 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_host = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_login = admin {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_mount_options = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_password = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_private_key = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_share_path = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.num_shell_tries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.quobyte_volume_url = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.replication_device = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.report_discard_supported = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.reserved_percentage = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.target_helper = tgtadm {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.target_port = 3260 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.target_protocol = iscsi {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.trace_flags = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.unique_fqdn_network = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.use_chap_auth = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_backend_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_clear = zero {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_clear_ionice = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_clear_size = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_reports.file_event_handler = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_reports.log_dir = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.backend_availability_zone = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.backend_host = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.chap_password = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.chap_username = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.chiscsi_conf = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.disk_geometry = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.driver_client_cert = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.driver_data_namespace = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.driver_use_ssl = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.extra_capabilities = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.filter_function = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.goodness_function = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.iser_helper = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.iser_ip_address = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.iser_port = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.iser_target_prefix = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_host = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_login = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_mount_options = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_password = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_private_key = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_share_path = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_ssh_port = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.num_shell_tries = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.nvmet_port_id = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack quobyte-client[86647]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 21:14:02 devstack quobyte-client[86647]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.replication_device = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.report_discard_supported = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.reserved_percentage = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.scst_target_driver = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.storage_protocol = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.target_helper = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.target_ip_address = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.target_port = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.target_prefix = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.target_protocol = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.trace_flags = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.use_chap_auth = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=86642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:02 devstack cinder-volume[86642]: INFO cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a ... Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_clear = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 -c /etc/quobyte/client-cinder.cfg {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_clear_size = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] QuobyteHD.volumes_dir = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 -c /etc/quobyte/client-cinder.cfg Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.ssl = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_notifications.driver = [] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_notifications.retry = -1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] key_manager.fixed_key = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.barbican_api_version = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.barbican_endpoint = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.barbican_endpoint_type = public {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.barbican_region_name = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.cafile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.collect_timing = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.insecure = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.number_of_retries = 60 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.retry_delay = 1 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.send_service_user_token = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.split_loggers = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.timeout = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.tls_ciphers = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.tls_min_version = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.verify_ssl = True {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican.verify_ssl_path = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.auth_section = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.auth_type = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.cafile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.certfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.collect_timing = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.insecure = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.keyfile = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.split_loggers = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.timeout = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.tls_ciphers = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] barbican_service_user.tls_min_version = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.approle_role_id = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.approle_secret_id = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.auth_method = approle {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.auth_path = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.kv_mountpoint = secret {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.kv_path = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.kv_version = 2 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.namespace = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.root_token_id = **** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.ssl_ca_crt_file = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.timeout = 60.0 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.token_file = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.token_role = None {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.use_ssl = False {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] ******************************************************************************** {{(pid=86418) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:14:03 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.433s {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:03 devstack cinder-volume[86642]: INFO cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a succeeded Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=86642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.443s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:03 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:14:03 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:03 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.241s {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:03 devstack cinder-volume[86642]: INFO cinder.volume.driver [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.volume.driver [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86642) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_db.sqlalchemy.engines [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG dbcounter [-] [86642] Writer thread running {{(pid=86642) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.db.api [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Building query based on filter {{(pid=86642) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.image.image_utils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86642) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:14:03 devstack cinder-volume[86642]: INFO cinder.keymgr.migration [None req-845c6a1d-8972-4e8c-9b71-6a676842098a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=86642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=86642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:03 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:14:03 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:03 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.245s {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.manager [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Notifying Schedulers of capabilities ... {{(pid=86642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:03 devstack cinder-volume[86642]: INFO cinder.volume.manager [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Driver initialization completed successfully. Nov 06 21:14:03 devstack cinder-volume[86642]: INFO cinder.manager [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Initiating service 3 cleanup Nov 06 21:14:03 devstack cinder-volume[86642]: INFO cinder.manager [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Service 3 cleanup completed. Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.service [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Creating RPC server for service cinder-volume {{(pid=86642) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.service [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86642) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:14:03 devstack cinder-volume[86642]: INFO cinder.volume.manager [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=86642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=86642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:03 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:03 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:14:03 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:04 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:04 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.294s {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:04 devstack cinder-volume[86642]: INFO cinder.volume.manager [None req-a211f8dd-4e5c-4a54-9d9f-7c018ada59f1 None None] Driver post RPC initialization completed successfully. Nov 06 21:14:06 devstack cinder-volume[86642]: DEBUG oslo_service.periodic_task [None req-e1cbf82f-0d61-482c-abae-655e2dd603a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86642) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:14:06 devstack cinder-volume[86642]: DEBUG cinder.volume.manager [None req-e1cbf82f-0d61-482c-abae-655e2dd603a0 None None] thread count: 6 {{(pid=86642) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:14:06 devstack cinder-volume[86642]: DEBUG cinder.volume.manager [None req-e1cbf82f-0d61-482c-abae-655e2dd603a0 None None] thread info: [<_MainThread(MainThread, started 131939458125952)>, , , , , ] {{(pid=86642) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=86642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG cinder.volume.drivers.quobyte [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=86642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86642) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:08 devstack sudo[86933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:14:08 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:08 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG oslo_concurrency.processutils [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.234s {{(pid=86642) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:08 devstack cinder-volume[86642]: DEBUG cinder.manager [None req-be9f7a49-a9b5-4ab6-baf8-a1f50d605658 None None] Notifying Schedulers of capabilities ... {{(pid=86642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:11 devstack cinder-volume[86418]: INFO oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Caught SIGTERM, stopping children Nov 06 21:14:11 devstack cinder-volume[86418]: DEBUG oslo_concurrency.lockutils [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Acquiring lock "singleton_lock" {{(pid=86418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:11 devstack cinder-volume[86418]: DEBUG oslo_concurrency.lockutils [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Acquired lock "singleton_lock" {{(pid=86418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:11 devstack cinder-volume[86418]: DEBUG oslo_concurrency.lockutils [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Releasing lock "singleton_lock" {{(pid=86418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:11 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Stop services. {{(pid=86418) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:14:11 devstack cinder-volume[86418]: DEBUG oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Killing children. {{(pid=86418) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:14:11 devstack cinder-volume[86418]: INFO oslo_service.backend._eventlet.service [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Waiting on 1 children to exit Nov 06 21:14:14 devstack cinder-volume[86642]: DEBUG dbcounter [-] [86642] Writing DB stats cinder:SELECT=4 {{(pid=86642) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:14 devstack cinder-volume[86642]: DEBUG dbcounter [-] [86642] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86642) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:16 devstack cinder-volume[86642]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 06 21:14:16 devstack cinder-volume[87152]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:14:16 devstack cinder-volume[87152]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:14:16 devstack cinder-volume[87152]: we strongly recommend against using it for new projects. Nov 06 21:14:16 devstack cinder-volume[87152]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:14:16 devstack cinder-volume[87152]: framework. For more detail see Nov 06 21:14:16 devstack cinder-volume[87152]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:14:16 devstack cinder-volume[87152]: import eventlet # noqa Nov 06 21:14:17 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Acquiring lock "singleton_lock" {{(pid=86642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:17 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Acquired lock "singleton_lock" {{(pid=86642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:17 devstack cinder-volume[86642]: DEBUG oslo_concurrency.lockutils [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Releasing lock "singleton_lock" {{(pid=86642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:17 devstack cinder-volume[86642]: WARNING amqp [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:14:17 devstack cinder-volume[86642]: WARNING amqp [None req-5182088a-fb88-4351-bffc-a100818ee3dc None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:14:19 devstack cinder-volume[87152]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:19 devstack cinder-volume[87152]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:19 devstack cinder-volume[87152]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:19 devstack cinder-volume[87152]: INFO dbcounter [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Registered counter for database cinder Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG dbcounter [-] [87152] Writer thread running {{(pid=87152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:20 devstack cinder-volume[87152]: INFO cinder.rpc [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:14:20 devstack cinder-volume[87152]: INFO cinder.rpc [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:20 devstack cinder-volume[87152]: INFO cinder.volume.manager [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Determined volume DB was empty at startup. Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG cinder.volume.manager [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87152) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 21:14:20 devstack cinder-volume[87152]: WARNING stevedore.named [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:14:20 devstack cinder-volume[87152]: WARNING castellan.key_manager [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:20 devstack cinder-volume[87152]: WARNING cinder.keymgr.conf_key_mgr [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:20 devstack cinder-volume[87152]: INFO cinder.volume.manager [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:20 devstack cinder-volume[87152]: INFO oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Starting 1 workers Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Started child 87450 {{(pid=87152) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Full set of CONF: {{(pid=87152) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] ******************************************************************************** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] Configuration options gathered from: {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] ================================================================================ {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] allow_availability_zone_fallback = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] allow_compression_on_image_upload = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] allowed_direct_url_schemes = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] api_rate_limit = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] auth_strategy = keystone {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_availability_zone = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_host = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_stats_polling_interval = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backup_api_class = cinder.backup.api.API {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backup_name_template = backup-%s {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backup_use_same_host = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backup_use_temp_snapshot = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] chap_password = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] chap_username = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_internal_tenant_project_id = c0ff76ec524e4215aa05ef86f1cede08 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_internal_tenant_user_id = 4d4839d02b2742aeb82207275fff9132 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cluster = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] compression_format = gzip {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] compute_api_class = cinder.compute.nova.API {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] config_dir = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] config_source = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87450]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] control_exchange = openstack {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] debug = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] default_availability_zone = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] default_group_type = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] default_volume_type = QuobyteHD {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] disk_geometry = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] driver_client_cert = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] driver_client_cert_key = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] driver_data_namespace = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] driver_ssl_cert_path = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] driver_ssl_cert_verify = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] driver_use_ssl = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] enable_new_services = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] enable_unsupported_driver = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] enabled_backends = ['QuobyteHD'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] enforce_multipath_for_image_xfer = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] filter_function = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_api_insecure = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_api_ssl_compression = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_ca_certificates_file = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_catalog_info = image:glance:publicURL {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_num_retries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance_request_timeout = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] goodness_function = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] graceful_shutdown_timeout = 5 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] group_api_class = cinder.group.api.API {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] host = devstack {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_compress_on_upload = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_conversion_address_space_limit = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_conversion_cpu_limit = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_conversion_disable = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_introspection_address_space_limit = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_introspection_cpu_limit = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_upload_use_cinder_backend = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_upload_use_internal_tenant = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_volume_cache_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_volume_cache_max_count = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] image_volume_cache_max_size_gb = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] init_host_max_objects_retrieval = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] instance_format = [instance: %(uuid)s] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] iscsi_target_flags = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] iscsi_write_cache = on {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] iser_helper = tgtadm {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] iser_ip_address = 192.168.122.192 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] iser_port = 3260 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_color = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_config_append = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_dir = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_file = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_options = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_rotate_interval = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_rotate_interval_type = days {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] log_rotation_type = none {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] max_age = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] max_logfile_count = 30 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] max_logfile_size_mb = 200 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] max_over_subscription_ratio = 20.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] message_reap_interval = 86400 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] message_ttl = 2592000 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] migration_create_volume_timeout_secs = 300 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] monkey_patch = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] monkey_patch_modules = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] my_ip = 192.168.122.192 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] no_snapshot_gb_quota = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] num_iser_scan_tries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] num_shell_tries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] num_volume_device_scan_tries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] nvmeof_conn_info_version = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] nvmet_ns_id = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] nvmet_port_id = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] osapi_max_limit = 1000 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] osapi_volume_ext_list = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] osapi_volume_listen_port = 8776 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] osapi_volume_use_ssl = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] osapi_volume_workers = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] per_volume_size_limit = -1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] periodic_fuzzy_delay = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] periodic_interval = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] public_endpoint = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] publish_errors = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] quota_backup_gigabytes = 1000 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] quota_backups = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] quota_gigabytes = 1000 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] quota_groups = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] quota_snapshots = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] quota_volumes = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] rate_limit_burst = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] rate_limit_except_level = CRITICAL {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] rate_limit_interval = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] reinit_driver_count = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] replication_device = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] report_discard_supported = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] report_interval = 120 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] reservation_clean_interval = 86400 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] reservation_expire = 86400 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] reserved_image_namespaces = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] reserved_percentage = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] rpc_response_timeout = 120 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] run_external_periodic_tasks = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] scst_target_driver = iscsi {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] scst_target_iqn_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_down_time = 720 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] shell_completion = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] snapshot_name_template = snapshot-%s {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] split_loggers = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] state_path = /opt/stack/data/cinder {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] storage_availability_zone = nova {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] storage_protocol = iSCSI {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] syslog_log_facility = LOG_USER {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] target_helper = lioadm {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] target_ip_address = 192.168.122.192 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] target_port = 3260 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] target_protocol = iscsi {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] target_secondary_ip_addresses = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] trace_flags = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] transport_url = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] until_refresh = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] use_chap_auth = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] use_default_quota_class = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] use_journal = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] use_json = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] use_multipath_for_image_xfer = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] use_stderr = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] use_syslog = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] verify_glance_signatures = enabled {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_api_class = cinder.volume.api.API {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_backend_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_clear = zero {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_clear_ionice = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_clear_size = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_copy_bps_limit = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_dd_blocksize = 1M {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_name_template = volume-%s {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_service_inithost_offload = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volume_usage_audit_period = month {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] zoning_mode = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_concurrency.disable_process_locking = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.auth_section = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.auth_type = password {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.auth_version = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87450) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.cache = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.include_service_catalog = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.insecure = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.interface = public {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_password = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcache_username = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.region_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.service_type = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.backend = dogpile.cache.null {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.backend_argument = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.backend_expiration_time = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.config_prefix = cache.oslo {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.debug_cache_backend = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.enable_retry_client = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.enable_socket_keepalive = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.expiration_time = 600 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.hashclient_retry_attempts = 2 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.memcache_dead_retry = 300 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.memcache_pool_maxsize = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.memcache_sasl_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.password = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.proxies = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.redis_db = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.redis_server = localhost:6379 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.retry_attempts = 2 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.retry_delay = 0.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.socket_keepalive_count = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.socket_keepalive_idle = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.socket_keepalive_interval = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.socket_timeout = 1.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.tls_allowed_ciphers = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.tls_cafile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.tls_certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.tls_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.tls_keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cache.username = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] coordination.backend_url = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.asyncio_connection = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.asyncio_slave_connection = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.backend = sqlalchemy {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.connection = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.connection_debug = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.connection_parameters = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.connection_recycle_time = 3600 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.connection_trace = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.db_inc_retry_interval = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.db_max_retries = 20 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.db_max_retry_interval = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.db_retry_interval = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.max_overflow = 50 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.max_pool_size = 5 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.max_retries = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.mysql_wsrep_sync_wait = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.pool_timeout = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.retry_interval = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.slave_connection = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.sqlite_synchronous = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.synchronous_reader = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] database.use_db_reconnect = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_tracing.insecure = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.connection_string = messaging:// {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.es_doc_type = notification {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.es_scroll_size = 10000 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.es_scroll_time = 2m {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.filter_error_trace = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.hmac_keys = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.sentinel_service_name = mymaster {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.socket_timeout = 0.1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.trace_requests = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler.trace_sqlalchemy = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler_jaeger.process_tags = {} {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler_jaeger.service_name_prefix = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] profiler_otlp.service_name_prefix = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.enforce_new_defaults = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.policy_default_rule = default {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.policy_file = policy.yaml {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] privsep_osbrick.group = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] privsep_osbrick.helper_command = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] privsep_osbrick.user = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_sys_admin.group = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_sys_admin.helper_command = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] cinder_sys_admin.user = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.auth_section = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.auth_type = password {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.cafile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.collect_timing = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.insecure = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.send_service_user_token = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.split_loggers = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.timeout = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.tls_ciphers = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] service_user.tls_min_version = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.auth_section = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.auth_type = password {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.collect_timing = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.insecure = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.region_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.split_loggers = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.timeout = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.tls_ciphers = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] glance.tls_min_version = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.backend_availability_zone = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.chap_password = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.chap_username = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.disk_geometry = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.driver_client_cert = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.driver_client_cert_key = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.driver_data_namespace = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.driver_use_ssl = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.extra_capabilities = {} {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.filter_function = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.goodness_function = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.iscsi_target_flags = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.iscsi_write_cache = on {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.iser_helper = tgtadm {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.iser_port = 3260 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_host = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_login = admin {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_mount_options = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_password = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_private_key = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_share_path = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.num_shell_tries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.quobyte_volume_url = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.replication_device = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.report_discard_supported = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.reserved_percentage = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.target_helper = tgtadm {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.target_port = 3260 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.target_protocol = iscsi {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.trace_flags = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.unique_fqdn_network = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.use_chap_auth = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_backend_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_clear = zero {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_clear_ionice = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_clear_size = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_reports.file_event_handler = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_reports.log_dir = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.backend_availability_zone = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.backend_host = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.chap_password = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.chap_username = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.chiscsi_conf = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.disk_geometry = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.driver_client_cert = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.driver_data_namespace = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.driver_use_ssl = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.extra_capabilities = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.filter_function = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.goodness_function = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.iser_helper = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.iser_ip_address = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.iser_port = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.iser_target_prefix = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_host = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_login = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_mount_options = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_password = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_private_key = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_share_path = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_ssh_port = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.num_shell_tries = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.nvmet_port_id = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.replication_device = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.report_discard_supported = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.reserved_percentage = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.scst_target_driver = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.storage_protocol = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.target_helper = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.target_ip_address = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.target_port = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.target_prefix = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.target_protocol = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.trace_flags = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.use_chap_auth = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_clear = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_clear_size = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] QuobyteHD.volumes_dir = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.ssl = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_notifications.driver = [] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_notifications.retry = -1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] key_manager.fixed_key = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.barbican_api_version = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.barbican_endpoint = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.barbican_endpoint_type = public {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.barbican_region_name = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.cafile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87450) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:14:20 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:14:20 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.collect_timing = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.insecure = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.number_of_retries = 60 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.retry_delay = 1 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.send_service_user_token = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Running cmd (subprocess): mount.quobyte {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.split_loggers = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.timeout = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.tls_ciphers = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.tls_min_version = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.verify_ssl = True {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican.verify_ssl_path = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.auth_section = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.auth_type = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.cafile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.certfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.collect_timing = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.insecure = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.keyfile = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.split_loggers = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.timeout = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.tls_ciphers = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] barbican_service_user.tls_min_version = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.approle_role_id = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.approle_secret_id = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.auth_method = approle {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.auth_path = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.kv_mountpoint = secret {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.kv_path = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.kv_version = 2 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.namespace = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.root_token_id = **** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.ssl_ca_crt_file = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.timeout = 60.0 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.token_file = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.token_role = None {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.use_ssl = False {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87152]: DEBUG oslo_service.backend._eventlet.service [None req-7b9403d2-84bf-4450-a73d-3995fe83bdf2 None None] ******************************************************************************** {{(pid=87152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:14:21 devstack quobyte-client[87451]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 21:14:21 devstack quobyte-client[87451]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:21 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:14:21 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:21 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:21 devstack cinder-volume[87450]: INFO cinder.volume.driver [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.volume.driver [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87450) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_db.sqlalchemy.engines [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writer thread running {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.db.api [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Building query based on filter {{(pid=87450) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87450) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:21 devstack cinder-volume[87450]: INFO cinder.keymgr.migration [None req-97294068-e94d-417f-beaf-19ae8d2a4c22 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:14:21 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:14:21 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:21 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.242s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Driver initialization completed successfully. Nov 06 21:14:21 devstack cinder-volume[87450]: INFO cinder.manager [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Initiating service 3 cleanup Nov 06 21:14:21 devstack cinder-volume[87450]: INFO cinder.manager [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Service 3 cleanup completed. Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.service [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Creating RPC server for service cinder-volume {{(pid=87450) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.service [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87450) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:14:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:21 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:14:21 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:22 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fcfe32e5-d25f-428e-9bf9-295b7acd5125 None None] Driver post RPC initialization completed successfully. Nov 06 21:14:30 devstack cinder-volume[87152]: DEBUG dbcounter [-] [87152] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:31 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:32 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=2 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:15:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:15:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 6 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:15:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Flow 'volume_create_manager' (7514af7b-eff7-49f3-a58e-70d83c8c4b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cfe9ba-324a-4cf6-a60e-0a4e70edd578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cfe9ba-324a-4cf6-a60e-0a4e70edd578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1178342106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ecd53f-332b-4c21-9b0f-257aeb96f8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ec55ae9b2d49c18e1eb84f240ab6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:22Z,use_quota=True,user_id='65ade67b9a1e4f03aebbe1d8f8bd42af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bd2d5c-64d4-4927-ac7d-56c0419ce89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bd2d5c-64d4-4927-ac7d-56c0419ce89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c3163b-ee10-4dd2-bbf9-932097398717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c3163b-ee10-4dd2-bbf9-932097398717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ecd53f-332b-4c21-9b0f-257aeb96f8a5', 'volume_name': 'volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70020667-87cd-440d-a9d8-090b7c13b620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70020667-87cd-440d-a9d8-090b7c13b620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652f2eb4-bb58-4066-ba52-941fd9a40f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Volume 91ecd53f-332b-4c21-9b0f-257aeb96f8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5', 'volume_size': 1} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1178342106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ecd53f-332b-4c21-9b0f-257aeb96f8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ec55ae9b2d49c18e1eb84f240ab6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:22Z,use_quota=True,user_id='65ade67b9a1e4f03aebbe1d8f8bd42af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Creating volume 91ecd53f-332b-4c21-9b0f-257aeb96f8a5 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:15:22 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:22 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 1073741824 Nov 06 21:15:22 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:22 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 1073741824" returned: 0 in 0.770s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:23 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 Nov 06 21:15:23 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:23 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5" returned: 0 in 0.300s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652f2eb4-bb58-4066-ba52-941fd9a40f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b758757-a458-40ad-a97c-bf4f8309e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Volume volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 (91ecd53f-332b-4c21-9b0f-257aeb96f8a5): created successfully Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b758757-a458-40ad-a97c-bf4f8309e274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Flow 'volume_create_manager' (7514af7b-eff7-49f3-a58e-70d83c8c4b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-43d6b079-67db-4092-8d19-961e8b82bfd5 tempest-TaggedAttachmentsTest-1314440488 None] Created volume successfully. Nov 06 21:15:33 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:15:33 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Flow 'volume_create_manager' (b49fed19-80b4-4a26-aa97-756d180e8703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c531e54-f6e1-4d19-af72-3af302065a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c531e54-f6e1-4d19-af72-3af302065a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-679107282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03b6880bb34484494b7df39586be54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:54Z,use_quota=True,user_id='1e4242398a9c42fcab9d66851666335a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee785d3-ca0b-496f-87d9-1ac3d46c482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee785d3-ca0b-496f-87d9-1ac3d46c482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4157b5dc-45e1-498d-990b-55dfa4672632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4157b5dc-45e1-498d-990b-55dfa4672632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d', 'volume_name': 'volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58142ab0-3703-4144-ba19-9aa239ffcc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58142ab0-3703-4144-ba19-9aa239ffcc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdfcddf-cf1e-417b-a4a3-97855fc472b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:53 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Volume bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d', 'volume_size': 1} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-679107282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03b6880bb34484494b7df39586be54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:54Z,use_quota=True,user_id='1e4242398a9c42fcab9d66851666335a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Creating volume bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:15:53 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:15:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:54 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d 1073741824 Nov 06 21:15:54 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:55 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d 1073741824" returned: 0 in 1.071s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:55 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d Nov 06 21:15:55 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:55 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d" returned: 0 in 0.424s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdfcddf-cf1e-417b-a4a3-97855fc472b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c192598e-6c2a-4259-9224-b5b02b42c04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:55 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Volume volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d (bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d): created successfully Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c192598e-6c2a-4259-9224-b5b02b42c04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Flow 'volume_create_manager' (b49fed19-80b4-4a26-aa97-756d180e8703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:55 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-03778657-53f2-4e6a-9bd7-c6ca34a6bf83 tempest-VolumesAdminNegativeTest-2125783485 None] Created volume successfully. Nov 06 21:15:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Acquiring lock "cinder-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:15:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Lock "cinder-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:15:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Acquiring lock "cinder-quobyte-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:15:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Lock "cinder-quobyte-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:15:57 devstack cinder-volume[87450]: INFO oslo.privsep.daemon [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7c_1lyo6/privsep.sock'] Nov 06 21:15:57 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7c_1lyo6/privsep.sock Nov 06 21:15:57 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:16:00 devstack cinder-volume[87450]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 21:16:00 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:00 devstack cinder-volume[87450]: INFO oslo.privsep.daemon [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Spawned new privsep daemon via rootwrap Nov 06 21:16:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Accepted privsep connection to /tmp/tmp7c_1lyo6/privsep.sock {{(pid=87450) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 21:16:00 devstack cinder-volume[87450]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 21:16:00 devstack cinder-volume[87450]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 21:16:00 devstack cinder-volume[87450]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 21:16:00 devstack cinder-volume[87450]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88576 Nov 06 21:16:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0d8634-3468-4a7d-bf8a-ccd7d485604e]: (2,) {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:16:01 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c01357-e2de-4ef4-b348-f13f358f4e91]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:16:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:01 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d Nov 06 21:16:01 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:02 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d" returned: 0 in 1.233s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:02 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d Nov 06 21:16:02 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:03 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d" returned: 0 in 0.845s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Lock "cinder-quobyte-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d" released by "delete_volume" :: held 5.700s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:03 devstack cinder-volume[87450]: WARNING cinder.quota [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:16:03 devstack cinder-volume[87450]: WARNING cinder.quota [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Created reservations ['166fab22-48c0-4b1b-8c0a-613795a80994', '38ced163-4c6f-4cff-b821-34aa30628427', 'df911386-4936-4bc4-a9c6-53abff43a351', '1f41db29-8bb2-476f-82c2-5461db414bb1'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:03 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:16:03 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:04 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.831s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:04 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Deleted volume successfully. Nov 06 21:16:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-824f6736-0bc1-4e0d-9309-225f595bfd3a tempest-VolumesAdminNegativeTest-2125783485 None] Lock "cinder-bd5e85fc-a9c3-41af-a5b8-de7bbb9ccb5d-delete_volume" released by "delete_volume" :: held 7.365s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Flow 'volume_create_manager' (a18ce0cc-1661-47e5-afc6-9c2b6182d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c19f59-80a8-47de-85d8-0ddbdf4719b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c19f59-80a8-47de-85d8-0ddbdf4719b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1582333225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8170abd9-5cef-4ca0-b45b-244b14d19def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759393683e5f4438aba51043762b808c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:05Z,use_quota=True,user_id='484eb951038a4d279fe5dbb44be75c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe332637-dab7-4947-93ca-ad1544e8ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe332637-dab7-4947-93ca-ad1544e8ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a600913b-ff61-44e0-b572-3c8622500284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a600913b-ff61-44e0-b572-3c8622500284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8170abd9-5cef-4ca0-b45b-244b14d19def', 'volume_name': 'volume-8170abd9-5cef-4ca0-b45b-244b14d19def', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151ed0b8-40ec-4c41-bfa0-130083dc8443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151ed0b8-40ec-4c41-bfa0-130083dc8443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ad86c2-7f6d-452c-998d-36165c91bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:05 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Volume 8170abd9-5cef-4ca0-b45b-244b14d19def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8170abd9-5cef-4ca0-b45b-244b14d19def', 'volume_size': 1} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1582333225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8170abd9-5cef-4ca0-b45b-244b14d19def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759393683e5f4438aba51043762b808c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:05Z,use_quota=True,user_id='484eb951038a4d279fe5dbb44be75c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Creating volume 8170abd9-5cef-4ca0-b45b-244b14d19def {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:16:05 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:16:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:05 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def 1073741824 Nov 06 21:16:05 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:06 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def 1073741824" returned: 0 in 1.290s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:06 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def Nov 06 21:16:06 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:07 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def" returned: 0 in 0.463s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:16:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ad86c2-7f6d-452c-998d-36165c91bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8170abd9-5cef-4ca0-b45b-244b14d19def', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649bd889-dd97-4b33-95e4-8ef7e6f07045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Volume volume-8170abd9-5cef-4ca0-b45b-244b14d19def (8170abd9-5cef-4ca0-b45b-244b14d19def): created successfully Nov 06 21:16:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649bd889-dd97-4b33-95e4-8ef7e6f07045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Flow 'volume_create_manager' (a18ce0cc-1661-47e5-afc6-9c2b6182d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-044f5085-07f3-45c4-b535-ba3061e64728 tempest-ServerRescueNegativeTestJSON-1737657749 None] Created volume successfully. Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:11 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:16:11 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:11 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.385s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 8 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:16:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:16:17 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:17 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:32 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:32 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Acquiring lock "cinder-8170abd9-5cef-4ca0-b45b-244b14d19def-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "cinder-8170abd9-5cef-4ca0-b45b-244b14d19def-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Acquiring lock "cinder-quobyte-8170abd9-5cef-4ca0-b45b-244b14d19def" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "cinder-quobyte-8170abd9-5cef-4ca0-b45b-244b14d19def" acquired by "delete_volume" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f26931-8a20-46e5-b727-f77532eacda1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:16:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:33 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def Nov 06 21:16:33 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:33 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def" returned: 0 in 0.678s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:33 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def Nov 06 21:16:33 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:34 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8170abd9-5cef-4ca0-b45b-244b14d19def" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "cinder-quobyte-8170abd9-5cef-4ca0-b45b-244b14d19def" released by "delete_volume" :: held 1.105s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Created reservations ['2cd9d6fc-bf76-492b-9148-21611bf056ac', '20b9b4f8-96d6-45b4-b8fa-b15f20ce540c', '90c0df80-c01a-4fec-aebf-c9256573b63c', 'f1c733f2-2430-4978-98b8-cf7a2e5c0b28'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:34 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:16:34 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:34 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.483s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Deleted volume successfully. Nov 06 21:16:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-685213eb-c527-4948-a5ac-9f5591ab8035 tempest-ServerRescueNegativeTestJSON-1737657749 None] Lock "cinder-8170abd9-5cef-4ca0-b45b-244b14d19def-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Flow 'volume_create_manager' (886d518d-a3eb-466e-8001-9753d77cbe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ee164a-159f-4599-9049-0c3f81bbe01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ee164a-159f-4599-9049-0c3f81bbe01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2081121185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a05a1c-c2ed-41fd-a31f-9ad6432b078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc5fa29aad0451a836c2006d1e3b3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:44Z,use_quota=True,user_id='7a2631b802c448219358763f5d574ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52618134-724b-4243-8c5c-be3be2481489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52618134-724b-4243-8c5c-be3be2481489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911fad18-1789-4bc7-b540-039d9d53e73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911fad18-1789-4bc7-b540-039d9d53e73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a05a1c-c2ed-41fd-a31f-9ad6432b078d', 'volume_name': 'volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0deac80-494d-456d-a5dc-ca8b6897062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0deac80-494d-456d-a5dc-ca8b6897062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cc58da-0fcf-4b3f-95b5-d51af2f171be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:43 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Volume d1a05a1c-c2ed-41fd-a31f-9ad6432b078d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d', 'volume_size': 1} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2081121185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a05a1c-c2ed-41fd-a31f-9ad6432b078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc5fa29aad0451a836c2006d1e3b3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:44Z,use_quota=True,user_id='7a2631b802c448219358763f5d574ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Creating volume d1a05a1c-c2ed-41fd-a31f-9ad6432b078d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:16:43 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:16:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:43 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d 1073741824 Nov 06 21:16:43 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:44 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d 1073741824" returned: 0 in 0.912s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:44 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d Nov 06 21:16:44 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:45 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d" returned: 0 in 0.462s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:16:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cc58da-0fcf-4b3f-95b5-d51af2f171be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196dbc65-6752-46fd-9884-101c6d33b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Volume volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d (d1a05a1c-c2ed-41fd-a31f-9ad6432b078d): created successfully Nov 06 21:16:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196dbc65-6752-46fd-9884-101c6d33b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Flow 'volume_create_manager' (886d518d-a3eb-466e-8001-9753d77cbe0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e70fc937-635f-40b7-b73a-b471d15855bf tempest-DeleteServersTestJSON-1948635293 None] Created volume successfully. Nov 06 21:16:49 devstack cinder-volume[87450]: WARNING py.warnings [req-dadb5684-9f63-4bc0-ad40-5acbfee1b033 req-30a354f7-e027-4092-a0fa-0ec5e0c59f85 tempest-DeleteServersTestJSON-1948635293 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 06 21:16:49 devstack cinder-volume[87450]: .first() Nov 06 21:16:49 devstack cinder-volume[87450]: Nov 06 21:16:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-dadb5684-9f63-4bc0-ad40-5acbfee1b033 req-30a354f7-e027-4092-a0fa-0ec5e0c59f85 tempest-DeleteServersTestJSON-1948635293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-dadb5684-9f63-4bc0-ad40-5acbfee1b033 req-30a354f7-e027-4092-a0fa-0ec5e0c59f85 tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-dadb5684-9f63-4bc0-ad40-5acbfee1b033 req-30a354f7-e027-4092-a0fa-0ec5e0c59f85 tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-dadb5684-9f63-4bc0-ad40-5acbfee1b033 req-30a354f7-e027-4092-a0fa-0ec5e0c59f85 tempest-DeleteServersTestJSON-1948635293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3e934a9-6d2a-4cfd-9dd6-06e16fcbdd17', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:16:49 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-dadb5684-9f63-4bc0-ad40-5acbfee1b033 req-30a354f7-e027-4092-a0fa-0ec5e0c59f85 tempest-DeleteServersTestJSON-1948635293 None] attachment_update completed successfully. Nov 06 21:16:54 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-00b94206-15ab-4c32-8284-e05bd855017e req-1a8acd31-a33c-4ef3-ab36-fff05182d76c tempest-DeleteServersTestJSON-1948635293 None] Terminate volume connection completed successfully. Nov 06 21:16:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-00b94206-15ab-4c32-8284-e05bd855017e req-1a8acd31-a33c-4ef3-ab36-fff05182d76c tempest-DeleteServersTestJSON-1948635293 None] Deleting attachment c3e934a9-6d2a-4cfd-9dd6-06e16fcbdd17. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:16:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Acquiring lock "cinder-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Lock "cinder-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Acquiring lock "cinder-quobyte-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Lock "cinder-quobyte-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:57 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d799f5-1c8d-417f-adf2-8675df4d3a33]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:16:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:57 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d Nov 06 21:16:57 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:58 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d" returned: 0 in 0.664s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:58 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d Nov 06 21:16:58 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:58 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d" returned: 0 in 0.320s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Lock "cinder-quobyte-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d" released by "delete_volume" :: held 1.050s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Created reservations ['b6ed5838-3f35-4f04-b6f2-30c0bf5ff33b', '0256cce8-3edc-494d-a055-7b8b0fae7cd2', '8a838e19-6681-4335-b0cb-b6ae375a79c8', '0603f951-efb6-47d6-bd36-fe934bbe78ec'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:58 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:16:58 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:59 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.499s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Deleted volume successfully. Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ca12de0b-a589-4ee8-b4b9-3b7bf94dd512 tempest-DeleteServersTestJSON-1948635293 None] Lock "cinder-d1a05a1c-c2ed-41fd-a31f-9ad6432b078d-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-9d45e1db-9234-4620-b4fe-509fbd1c0fd0 req-afacb702-ef44-4904-aa14-4375ea0c177f tempest-TaggedAttachmentsTest-1314440488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-9d45e1db-9234-4620-b4fe-509fbd1c0fd0 req-afacb702-ef44-4904-aa14-4375ea0c177f tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-9d45e1db-9234-4620-b4fe-509fbd1c0fd0 req-afacb702-ef44-4904-aa14-4375ea0c177f tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Flow 'volume_create_manager' (934d068a-41ea-4d25-a2f9-af3df46cc2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e7a980-54e1-4ac0-b6b8-9181202100c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e7a980-54e1-4ac0-b6b8-9181202100c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-59972760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21da9442-e7fd-43a5-8ec0-165182e63a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd7b3ca2f384d069dcc725841437b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:59Z,use_quota=True,user_id='5aa13f5e281a43fdbdfa0897b6bb6cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2f9309-7ccb-4395-a98b-d42abfc84063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2f9309-7ccb-4395-a98b-d42abfc84063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc2503e-e9ed-49af-9e6d-4fc74c7a8c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc2503e-e9ed-49af-9e6d-4fc74c7a8c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21da9442-e7fd-43a5-8ec0-165182e63a02', 'volume_name': 'volume-21da9442-e7fd-43a5-8ec0-165182e63a02', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f7671-63e5-439c-a187-1624cf9b32e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f7671-63e5-439c-a187-1624cf9b32e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b931ac0-7822-4f86-9c64-a906961e19f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:59 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Volume 21da9442-e7fd-43a5-8ec0-165182e63a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21da9442-e7fd-43a5-8ec0-165182e63a02', 'volume_size': 1} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-59972760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21da9442-e7fd-43a5-8ec0-165182e63a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd7b3ca2f384d069dcc725841437b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:59Z,use_quota=True,user_id='5aa13f5e281a43fdbdfa0897b6bb6cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Creating volume 21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:16:59 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-9d45e1db-9234-4620-b4fe-509fbd1c0fd0 req-afacb702-ef44-4904-aa14-4375ea0c177f tempest-TaggedAttachmentsTest-1314440488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc9f5c3d-1431-4eac-942b-8925fccb91f8', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:16:59 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 1073741824 Nov 06 21:16:59 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-9d45e1db-9234-4620-b4fe-509fbd1c0fd0 req-afacb702-ef44-4904-aa14-4375ea0c177f tempest-TaggedAttachmentsTest-1314440488 None] attachment_update completed successfully. Nov 06 21:17:00 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 1073741824" returned: 0 in 0.739s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:00 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 Nov 06 21:17:00 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:00 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02" returned: 0 in 0.414s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b931ac0-7822-4f86-9c64-a906961e19f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21da9442-e7fd-43a5-8ec0-165182e63a02', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28a455e-c58f-4d7d-8e13-d1987d447dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Volume volume-21da9442-e7fd-43a5-8ec0-165182e63a02 (21da9442-e7fd-43a5-8ec0-165182e63a02): created successfully Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28a455e-c58f-4d7d-8e13-d1987d447dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Flow 'volume_create_manager' (934d068a-41ea-4d25-a2f9-af3df46cc2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-8c4e192d-8eac-48fe-8061-90e3fafc69e3 req-d19657f6-73f4-4d4e-a469-626d694c4355 tempest-VolumesSnapshotsTestJSON-721257879 None] Created volume successfully. Nov 06 21:17:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Creating offline snapshot 590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 of volume 21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:17:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8533d12e-bbe4-4916-b066-ae70cbe8a0e7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:02 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 Nov 06 21:17:02 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:02 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02" returned: 0 in 0.659s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:02 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 1G Nov 06 21:17:02 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-ad3a02e8-dc58-48d6-a24b-f55c7ee4264d req-bd7dda55-3cbb-4e1a-a8ad-43d87e5c7481 tempest-TaggedAttachmentsTest-1314440488 None] Terminate volume connection completed successfully. Nov 06 21:17:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-ad3a02e8-dc58-48d6-a24b-f55c7ee4264d req-bd7dda55-3cbb-4e1a-a8ad-43d87e5c7481 tempest-TaggedAttachmentsTest-1314440488 None] Deleting attachment cc9f5c3d-1431-4eac-942b-8925fccb91f8. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:17:03 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 1G" returned: 0 in 0.594s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21da9442-e7fd-43a5-8ec0-165182e63a02 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:03 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21da9442-e7fd-43a5-8ec0-165182e63a02 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 Nov 06 21:17:03 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:03 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21da9442-e7fd-43a5-8ec0-165182e63a02 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" returned: 0 in 0.381s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:03 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 is being set with open permissions: ugo+rw Nov 06 21:17:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:03 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 Nov 06 21:17:03 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:04 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" returned: 0 in 0.391s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:04 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.info Nov 06 21:17:04 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:04 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.info" returned: 0 in 0.371s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:04 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.info is being set with open permissions: ugo+rw Nov 06 21:17:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:04 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.info Nov 06 21:17:04 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:05 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.info" returned: 0 in 0.286s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-0f9f81fe-0cc4-41e3-8f52-f2407bbd929e req-e5c873a1-81d8-4347-9a98-3d80f7764ac2 tempest-VolumesSnapshotsTestJSON-721257879 None] Create snapshot completed successfully Nov 06 21:17:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "cinder-590dd5f8-3b3c-47f0-a6cb-25f6a06383b1-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-590dd5f8-3b3c-47f0-a6cb-25f6a06383b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "cinder-quobyte-21da9442-e7fd-43a5-8ec0-165182e63a02" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-quobyte-21da9442-e7fd-43a5-8ec0-165182e63a02" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "cinder-quobyte-590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-quobyte-590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Deleting offline snapshot 590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 of volume 21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] snapshot_file for this snap is: volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7790529e-7afb-4ede-af02-fe8431ef41f1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:06 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 Nov 06 21:17:06 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:06 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" returned: 0 in 0.567s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21da9442-e7fd-43a5-8ec0-165182e63a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f4efc-8bb9-4711-88a8-4d0d00a1a39a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:06 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 Nov 06 21:17:06 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:07 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02" returned: 0 in 0.535s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:07 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 Nov 06 21:17:07 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:07 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" returned: 0 in 0.519s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:07 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1 Nov 06 21:17:07 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:08 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02.590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" returned: 0 in 0.368s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-quobyte-590dd5f8-3b3c-47f0-a6cb-25f6a06383b1" released by "_delete_snapshot" :: held 2.185s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-quobyte-21da9442-e7fd-43a5-8ec0-165182e63a02" released by "delete_snapshot" :: held 2.224s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:08 devstack cinder-volume[87450]: WARNING cinder.quota [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:17:08 devstack cinder-volume[87450]: DEBUG cinder.quota [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Created reservations ['a1f8c6e5-15e5-4e7a-89a0-d3b64850989a', 'fe7ab04d-fc07-48f5-b641-da52e2ef58ae', '762880a4-ea1a-4bba-ad19-f78e2ae8f03c', '22149b24-519a-451a-b23c-55d7bcf53966'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:17:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Delete snapshot completed successfully. Nov 06 21:17:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-c63ce13b-20c2-48c5-bf26-b26f17a6036a req-6e6ef4b7-09c6-4b64-90bd-95dbd5000742 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-590dd5f8-3b3c-47f0-a6cb-25f6a06383b1-delete_snapshot" released by "delete_snapshot" :: held 2.508s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:11 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:17:11 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "cinder-21da9442-e7fd-43a5-8ec0-165182e63a02-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-21da9442-e7fd-43a5-8ec0-165182e63a02-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "cinder-quobyte-21da9442-e7fd-43a5-8ec0-165182e63a02" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-quobyte-21da9442-e7fd-43a5-8ec0-165182e63a02" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a84ed-959a-4caa-a101-15905eb166ac]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:11 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:11 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.375s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:17:11 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:11 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02" returned: 0 in 0.451s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:11 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02 Nov 06 21:17:11 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:12 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-21da9442-e7fd-43a5-8ec0-165182e63a02" returned: 0 in 0.267s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-quobyte-21da9442-e7fd-43a5-8ec0-165182e63a02" released by "delete_volume" :: held 0.813s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG cinder.quota [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Created reservations ['2ad8114e-7f5d-44fa-ab29-1cb302ac28c2', 'beffa274-abf7-4a78-b927-5fffd3e1c2ca', '6fed384d-4d51-464c-83ae-68c3ecbad4e9', '1952d04d-1cde-421b-a5f6-a77b61ea7085'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:12 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:17:12 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:12 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.333s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG cinder.manager [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:17:12 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Deleted volume successfully. Nov 06 21:17:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-ea98c6df-2638-430e-93e4-51d2003aabf4 req-83ae433c-33e0-4969-884a-ec2686b75498 tempest-VolumesSnapshotsTestJSON-721257879 None] Lock "cinder-21da9442-e7fd-43a5-8ec0-165182e63a02-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Acquiring lock "cinder-91ecd53f-332b-4c21-9b0f-257aeb96f8a5-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Lock "cinder-91ecd53f-332b-4c21-9b0f-257aeb96f8a5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Acquiring lock "cinder-quobyte-91ecd53f-332b-4c21-9b0f-257aeb96f8a5" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Lock "cinder-quobyte-91ecd53f-332b-4c21-9b0f-257aeb96f8a5" acquired by "delete_volume" :: waited 0.043s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[079f6cfe-0329-4f41-b069-3cdc0baa7a26]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:20 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 Nov 06 21:17:20 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:21 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5" returned: 0 in 0.806s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:21 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5 Nov 06 21:17:21 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:21 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91ecd53f-332b-4c21-9b0f-257aeb96f8a5" returned: 0 in 0.492s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Lock "cinder-quobyte-91ecd53f-332b-4c21-9b0f-257aeb96f8a5" released by "delete_volume" :: held 1.422s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Created reservations ['53ba89df-01b0-4a23-92df-ad1460cb1cc0', 'a77bfb48-8e16-4411-8cc3-f6cfb62156ba', '863770e0-867b-4924-860c-66534852d443', '444f2b0f-ce57-4f86-a7ac-1b9aca3f4403'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:21 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:17:21 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:22 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.447s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:22 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:17:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Deleted volume successfully. Nov 06 21:17:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bc84dd33-72df-4465-9671-0a18502a4a1f tempest-TaggedAttachmentsTest-1314440488 None] Lock "cinder-91ecd53f-332b-4c21-9b0f-257aeb96f8a5-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:31 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=50,cinder:INSERT=10,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:32 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=49,cinder:SELECT=46,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:43 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Flow 'volume_create_manager' (111c5353-7c4f-443e-9fc0-f6a236e47558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55173159-4585-4a5c-be38-8580f9f64cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55173159-4585-4a5c-be38-8580f9f64cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-950049406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12597da7-b29a-409d-957c-6bc32e2e97ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277230f13a7d48428810369ac3ad4f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:44Z,use_quota=True,user_id='068e96ed51f24f4da4afc0bb5f1415eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aab63df-e53f-4910-bb6e-685472aaa081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aab63df-e53f-4910-bb6e-685472aaa081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ff08f2-982d-4c0c-90e0-3ad40904c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ff08f2-982d-4c0c-90e0-3ad40904c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12597da7-b29a-409d-957c-6bc32e2e97ee', 'volume_name': 'volume-12597da7-b29a-409d-957c-6bc32e2e97ee', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f613937-7de0-4958-82e2-c660a3c53077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f613937-7de0-4958-82e2-c660a3c53077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901f0f33-881b-4ed7-8f5a-0c486cdf9500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:44 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Volume 12597da7-b29a-409d-957c-6bc32e2e97ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12597da7-b29a-409d-957c-6bc32e2e97ee', 'volume_size': 1} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-950049406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12597da7-b29a-409d-957c-6bc32e2e97ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277230f13a7d48428810369ac3ad4f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:44Z,use_quota=True,user_id='068e96ed51f24f4da4afc0bb5f1415eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Creating volume 12597da7-b29a-409d-957c-6bc32e2e97ee {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:17:44 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:17:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:44 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee 1073741824 Nov 06 21:17:44 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:45 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee 1073741824" returned: 0 in 0.877s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:45 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee Nov 06 21:17:45 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:45 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee" returned: 0 in 0.396s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901f0f33-881b-4ed7-8f5a-0c486cdf9500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12597da7-b29a-409d-957c-6bc32e2e97ee', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7728c1a-02d6-4298-9da4-e7356bcb61ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Volume volume-12597da7-b29a-409d-957c-6bc32e2e97ee (12597da7-b29a-409d-957c-6bc32e2e97ee): created successfully Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7728c1a-02d6-4298-9da4-e7356bcb61ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Flow 'volume_create_manager' (111c5353-7c4f-443e-9fc0-f6a236e47558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-379d684b-9ff1-46f5-bf38-da6aa8e395c4 tempest-ServerActionsTestOtherA-1380515094 None] Created volume successfully. Nov 06 21:17:55 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:55 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Flow 'volume_create_manager' (f939051b-6ca4-4dd8-b72f-d92056b00945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5c9e85-f29b-4994-a6d8-e8443058cfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5c9e85-f29b-4994-a6d8-e8443058cfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1573308611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa20423-14de-4506-bb6a-2397f7ec4a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b520141b0674188b25a28ca2cee14d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:58Z,use_quota=True,user_id='1f8f625eedb647ce8964e4b130ba8dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30a6adc-1307-44ea-b07c-dea0decbf2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30a6adc-1307-44ea-b07c-dea0decbf2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c55074-1294-4cf2-866e-1777f6e89944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c55074-1294-4cf2-866e-1777f6e89944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9aa20423-14de-4506-bb6a-2397f7ec4a04', 'volume_name': 'volume-9aa20423-14de-4506-bb6a-2397f7ec4a04', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df56f6d-072d-4bd2-a7f9-60a4837d1d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df56f6d-072d-4bd2-a7f9-60a4837d1d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e371eb9e-2f9e-4e2d-9e00-9e33af1508e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:58 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Volume 9aa20423-14de-4506-bb6a-2397f7ec4a04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9aa20423-14de-4506-bb6a-2397f7ec4a04', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:17:58 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Trying to clone 9aa20423-14de-4506-bb6a-2397f7ec4a04 from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:17:59 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:17:59 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:17:59 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f516b106-342f-4818-8ca3-8dd3c9bf520e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:59 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD Nov 06 21:17:59 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:00 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:00 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 is fetched for user 1f8f625eedb647ce8964e4b130ba8dca. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:18:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ddaac-f275-445f-8e1e-09d5c88bd984]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:00 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD Nov 06 21:18:00 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:01 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1573308611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa20423-14de-4506-bb6a-2397f7ec4a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b520141b0674188b25a28ca2cee14d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:58Z,use_quota=True,user_id='1f8f625eedb647ce8964e4b130ba8dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Creating volume 9aa20423-14de-4506-bb6a-2397f7ec4a04 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:01 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:18:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:01 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 1073741824 Nov 06 21:18:01 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:02 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 1073741824" returned: 0 in 1.104s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:02 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 Nov 06 21:18:02 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:02 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04" returned: 0 in 0.430s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Attempting download of 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume 9aa20423-14de-4506-bb6a-2397f7ec4a04. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8358dffc-0b92-4e4b-a746-f469d739b47b]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_wp_146hh {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:03 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_wp_146hh Nov 06 21:18:03 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:03 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_wp_146hh" returned: 0 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_wp_146hh {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:03 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_wp_146hh Nov 06 21:18:03 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:18:03 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Flow 'volume_create_manager' (9f0130e7-f7c0-4aab-b5c3-ddb50fb77440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1708d1f3-13e4-4cc5-933a-d6c760885692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_wp_146hh" returned: 1 in 0.543s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_wp_146hh' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda5d69f-6c01-406e-a188-2c0594d54381]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1708d1f3-13e4-4cc5-933a-d6c760885692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-665044492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6517938a7d4f7cb32f813e323e0b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:04Z,use_quota=True,user_id='4c8ca8f590f24c99bda139bda22a4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542e4f1d-10bf-4de9-8ff7-6d1b0f45b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542e4f1d-10bf-4de9-8ff7-6d1b0f45b06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a95dcf7-92d7-400c-8ec2-a11e47ffc04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a95dcf7-92d7-400c-8ec2-a11e47ffc04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5', 'volume_name': 'volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b959fce-193a-4e22-b4f1-ad6ce9162c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b959fce-193a-4e22-b4f1-ad6ce9162c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5d5724-9b93-489b-9b04-b0a7b3f4e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:04 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Volume c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5', 'volume_size': 1} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-665044492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6517938a7d4f7cb32f813e323e0b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:04Z,use_quota=True,user_id='4c8ca8f590f24c99bda139bda22a4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Creating volume c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:04 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:04 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 1073741824 Nov 06 21:18:04 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:04 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD Nov 06 21:18:04 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:04 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] 8c7c38c6-44d6-4400-a543-dd1512f9cf56 was qcow2, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:04 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 Nov 06 21:18:04 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:04 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 1073741824" returned: 0 in 0.627s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:04 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 Nov 06 21:18:04 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:05 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5" returned: 0 in 0.363s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5d5724-9b93-489b-9b04-b0a7b3f4e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65a94b3-3b47-4f24-9b98-6d730ea5f79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:05 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Volume volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 (c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5): created successfully Nov 06 21:18:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65a94b3-3b47-4f24-9b98-6d730ea5f79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Flow 'volume_create_manager' (9f0130e7-f7c0-4aab-b5c3-ddb50fb77440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-980888cc-d757-48bc-9206-4a4fb578af33 tempest-AttachVolumeTestJSON-992854155 None] Created volume successfully. Nov 06 21:18:08 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-2ecfbee2-2e57-4e21-8b89-7732e6beb323 req-f42bce17-815b-4a49-a68e-482564eaa134 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-2ecfbee2-2e57-4e21-8b89-7732e6beb323 req-f42bce17-815b-4a49-a68e-482564eaa134 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04" returned: 0 in 3.797s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:08 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_mujgi5icdevstack@QuobyteHD, size 112.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:18:08 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Converted 112.00 MB image at 29.45 MB/s Nov 06 21:18:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-2ecfbee2-2e57-4e21-8b89-7732e6beb323 req-f42bce17-815b-4a49-a68e-482564eaa134 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.107s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:08 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 1G Nov 06 21:18:08 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-2ecfbee2-2e57-4e21-8b89-7732e6beb323 req-f42bce17-815b-4a49-a68e-482564eaa134 tempest-AttachVolumeTestJSON-992854155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e431c792-2be7-4d39-aeb8-4919de52688f', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:18:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-2ecfbee2-2e57-4e21-8b89-7732e6beb323 req-f42bce17-815b-4a49-a68e-482564eaa134 tempest-AttachVolumeTestJSON-992854155 None] attachment_update completed successfully. Nov 06 21:18:09 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 1G" returned: 0 in 0.633s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Downloaded image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume 9aa20423-14de-4506-bb6a-2397f7ec4a04 successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 for user 1f8f625eedb647ce8964e4b130ba8dca is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Marking volume 9aa20423-14de-4506-bb6a-2397f7ec4a04 as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Copying metadata from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 to 9aa20423-14de-4506-bb6a-2397f7ec4a04. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Creating volume glance metadata for volume 9aa20423-14de-4506-bb6a-2397f7ec4a04 backed by image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e371eb9e-2f9e-4e2d-9e00-9e33af1508e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa20423-14de-4506-bb6a-2397f7ec4a04', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623cf43a-bd6d-4f72-b37e-1287c8d43c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:09 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Volume volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 (9aa20423-14de-4506-bb6a-2397f7ec4a04): created successfully Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623cf43a-bd6d-4f72-b37e-1287c8d43c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Flow 'volume_create_manager' (f939051b-6ca4-4dd8-b72f-d92056b00945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-abfa92ca-f206-4009-be3f-c9d5ce8a5483 tempest-VolumesImageMetadata-722589630 None] Created volume successfully. Nov 06 21:18:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Acquiring lock "cinder-9aa20423-14de-4506-bb6a-2397f7ec4a04-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Lock "cinder-9aa20423-14de-4506-bb6a-2397f7ec4a04-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Acquiring lock "cinder-quobyte-9aa20423-14de-4506-bb6a-2397f7ec4a04" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Lock "cinder-quobyte-9aa20423-14de-4506-bb6a-2397f7ec4a04" acquired by "delete_volume" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:10 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cd070f-c60d-4251-99aa-b1ec4c89006b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:11 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 Nov 06 21:18:11 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:11 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:18:11 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:11 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.460s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:18:11 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04" returned: 0 in 0.855s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:11 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04 Nov 06 21:18:11 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:11 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9aa20423-14de-4506-bb6a-2397f7ec4a04" returned: 0 in 0.329s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Lock "cinder-quobyte-9aa20423-14de-4506-bb6a-2397f7ec4a04" released by "delete_volume" :: held 1.307s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Created reservations ['1ecf8cbd-d446-4ca0-bfc6-279f6b0c8ea0', '3d42043a-5c53-4104-aba8-8e8b4cfbdde9', 'd3d32c17-557c-44b9-a88b-40327b232032', '6a83cf85-0c14-4a12-aa92-efebf650cf66'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:12 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:18:12 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:12 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.534s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:12 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Deleted volume successfully. Nov 06 21:18:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8344f777-8b72-4276-b75f-70d7218ddc5a tempest-VolumesImageMetadata-722589630 None] Lock "cinder-9aa20423-14de-4506-bb6a-2397f7ec4a04-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Flow 'volume_create_manager' (21ae5904-37d5-4be4-b486-c19095ec15ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0ed487-20fd-4da9-be8c-9926b14fba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0ed487-20fd-4da9-be8c-9926b14fba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1869849550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f743d2f-8dda-441e-8293-7378f6f39efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65095025f4ac48d89c70c2c1996b46fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:22Z,use_quota=True,user_id='e027f85c06e043de815ff79da387e255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54df9825-b04a-4eeb-8e99-0f3e3b8c1131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54df9825-b04a-4eeb-8e99-0f3e3b8c1131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5965fe-d644-4051-a6ca-6f04e802df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5965fe-d644-4051-a6ca-6f04e802df6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f743d2f-8dda-441e-8293-7378f6f39efc', 'volume_name': 'volume-7f743d2f-8dda-441e-8293-7378f6f39efc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02e3d4a-4e32-44d8-a543-17188c1c0246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02e3d4a-4e32-44d8-a543-17188c1c0246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b0c396-45d9-483d-a65d-5081baf7eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Volume 7f743d2f-8dda-441e-8293-7378f6f39efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f743d2f-8dda-441e-8293-7378f6f39efc', 'volume_size': 1} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1869849550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f743d2f-8dda-441e-8293-7378f6f39efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65095025f4ac48d89c70c2c1996b46fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:22Z,use_quota=True,user_id='e027f85c06e043de815ff79da387e255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Creating volume 7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:22 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:18:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:23 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc 1073741824 Nov 06 21:18:23 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:24 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc 1073741824" returned: 0 in 1.502s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:24 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc Nov 06 21:18:24 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:24 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc" returned: 0 in 0.410s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b0c396-45d9-483d-a65d-5081baf7eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f743d2f-8dda-441e-8293-7378f6f39efc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2431a9-bf32-4243-a768-f41cc94ce50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Volume volume-7f743d2f-8dda-441e-8293-7378f6f39efc (7f743d2f-8dda-441e-8293-7378f6f39efc): created successfully Nov 06 21:18:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2431a9-bf32-4243-a768-f41cc94ce50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Flow 'volume_create_manager' (21ae5904-37d5-4be4-b486-c19095ec15ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0bd76a43-b6b1-46c5-9bab-7d10d0086cc8 tempest-VolumesDeleteCascade-276203281 None] Created volume successfully. Nov 06 21:18:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Creating offline snapshot 24f782c6-a194-49b9-83ad-6012ce4af026 of volume 7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:18:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea23ab56-db3d-457c-a650-9a9654156f83]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:26 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc Nov 06 21:18:26 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:26 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc" returned: 0 in 0.658s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:26 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 1G Nov 06 21:18:26 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-25420d7c-70c2-41f3-a17a-56f8a05da9ac req-3cf5c90e-a534-42a8-b913-27ec09203b9b tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:27 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 1G" returned: 0 in 0.981s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:27 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 Nov 06 21:18:27 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:28 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026" returned: 0 in 0.382s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:28 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 is being set with open permissions: ugo+rw Nov 06 21:18:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:28 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 Nov 06 21:18:28 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:28 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026" returned: 0 in 0.312s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:28 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.info Nov 06 21:18:28 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:28 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.info" returned: 0 in 0.468s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:28 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.info is being set with open permissions: ugo+rw Nov 06 21:18:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:28 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.info Nov 06 21:18:28 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:29 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.info" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-25420d7c-70c2-41f3-a17a-56f8a05da9ac req-3cf5c90e-a534-42a8-b913-27ec09203b9b tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.963s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-25420d7c-70c2-41f3-a17a-56f8a05da9ac req-3cf5c90e-a534-42a8-b913-27ec09203b9b tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2bb19013-9458-4bcb-8531-3f22a2441e44 tempest-VolumesDeleteCascade-276203281 None] Create snapshot completed successfully Nov 06 21:18:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-25420d7c-70c2-41f3-a17a-56f8a05da9ac req-3cf5c90e-a534-42a8-b913-27ec09203b9b tempest-ServerActionsTestOtherA-1380515094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-12597da7-b29a-409d-957c-6bc32e2e97ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa583532-3f0e-4e93-8d5a-e0054d9bb9f5', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:18:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-25420d7c-70c2-41f3-a17a-56f8a05da9ac req-3cf5c90e-a534-42a8-b913-27ec09203b9b tempest-ServerActionsTestOtherA-1380515094 None] attachment_update completed successfully. Nov 06 21:18:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Creating offline snapshot 9ea49e19-b006-4423-a18a-0612fa2076f8 of volume 7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:18:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6657f51-daa4-43a0-b102-019df30dda9f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:30 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 Nov 06 21:18:30 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Flow 'volume_create_manager' (bb789bf6-eece-48d8-830a-7645d399e88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8138dba-48e0-4119-a574-6f9cc6bb4ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8138dba-48e0-4119-a574-6f9cc6bb4ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-160147472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd63332-44ff-4f06-9065-dada7377735f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c80fc551e246779788c971deab799e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:31Z,use_quota=True,user_id='d76c83c226c54c28ac7af62e44cb088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36b2c7-7300-4cd4-b3c2-56c013de30e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36b2c7-7300-4cd4-b3c2-56c013de30e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a76210d-12d3-499d-8510-1f7230b08f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a76210d-12d3-499d-8510-1f7230b08f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd63332-44ff-4f06-9065-dada7377735f', 'volume_name': 'volume-ecd63332-44ff-4f06-9065-dada7377735f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d5936d-df73-4e20-a4ff-98b709c8bc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d5936d-df73-4e20-a4ff-98b709c8bc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ff63a5-73b9-4c8b-8a59-4817e85b5ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Volume ecd63332-44ff-4f06-9065-dada7377735f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd63332-44ff-4f06-9065-dada7377735f', 'volume_size': 1} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:31 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026" returned: 0 in 0.752s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f743d2f-8dda-441e-8293-7378f6f39efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:18:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:31 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 1G Nov 06 21:18:31 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:32 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 1G" returned: 0 in 0.805s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:32 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 Nov 06 21:18:32 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:32 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8" returned: 0 in 0.456s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:32 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 is being set with open permissions: ugo+rw Nov 06 21:18:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:32 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 Nov 06 21:18:32 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:33 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8" returned: 0 in 0.527s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.693s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.900s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-160147472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd63332-44ff-4f06-9065-dada7377735f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c80fc551e246779788c971deab799e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:31Z,use_quota=True,user_id='d76c83c226c54c28ac7af62e44cb088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Creating volume ecd63332-44ff-4f06-9065-dada7377735f {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:33 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-800d6362-d010-41ad-b163-e61b31810148 tempest-VolumesDeleteCascade-276203281 None] Create snapshot completed successfully Nov 06 21:18:33 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f 1073741824 Nov 06 21:18:33 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:33 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f 1073741824" returned: 0 in 0.603s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-7f743d2f-8dda-441e-8293-7378f6f39efc-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-7f743d2f-8dda-441e-8293-7378f6f39efc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:33 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f Nov 06 21:18:33 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-5c055261-d1c6-48ab-831b-b98e80d293fa req-af9e9960-3fcb-4f22-a1d7-9cba6c10c1a0 tempest-ServerActionsTestOtherA-1380515094 None] Terminate volume connection completed successfully. Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-5c055261-d1c6-48ab-831b-b98e80d293fa req-af9e9960-3fcb-4f22-a1d7-9cba6c10c1a0 tempest-ServerActionsTestOtherA-1380515094 None] Deleting attachment fa583532-3f0e-4e93-8d5a-e0054d9bb9f5. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Performing cascade delete. {{(pid=87450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 21:18:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-24f782c6-a194-49b9-83ad-6012ce4af026-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-24f782c6-a194-49b9-83ad-6012ce4af026-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-24f782c6-a194-49b9-83ad-6012ce4af026" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-24f782c6-a194-49b9-83ad-6012ce4af026" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Deleting offline snapshot 24f782c6-a194-49b9-83ad-6012ce4af026 of volume 7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] snapshot_file for this snap is: volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd6741a-3463-45eb-a386-250767542360]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:34 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 Nov 06 21:18:34 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:34 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f" returned: 0 in 0.709s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ff63a5-73b9-4c8b-8a59-4817e85b5ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd63332-44ff-4f06-9065-dada7377735f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce1c74b-17ba-48c7-8488-56f8a986aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Volume volume-ecd63332-44ff-4f06-9065-dada7377735f (ecd63332-44ff-4f06-9065-dada7377735f): created successfully Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce1c74b-17ba-48c7-8488-56f8a986aac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Flow 'volume_create_manager' (bb789bf6-eece-48d8-830a-7645d399e88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fccc511e-89cf-431e-90a1-60b00ea66810 tempest-ServersNegativeTestJSON-1056445255 None] Created volume successfully. Nov 06 21:18:35 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026" returned: 0 in 0.909s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f743d2f-8dda-441e-8293-7378f6f39efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a7c6bd-a99f-4d2f-b13d-3fbae032af96]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:35 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc Nov 06 21:18:35 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-5c055261-d1c6-48ab-831b-b98e80d293fa req-b3a509bf-df2c-4014-bdd0-4189ea03269b tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-5c055261-d1c6-48ab-831b-b98e80d293fa req-b3a509bf-df2c-4014-bdd0-4189ea03269b tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-5c055261-d1c6-48ab-831b-b98e80d293fa req-b3a509bf-df2c-4014-bdd0-4189ea03269b tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-5c055261-d1c6-48ab-831b-b98e80d293fa req-b3a509bf-df2c-4014-bdd0-4189ea03269b tempest-ServerActionsTestOtherA-1380515094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-12597da7-b29a-409d-957c-6bc32e2e97ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '846dfc92-ebd6-409a-a84a-803b1e47af7c', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:18:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-5c055261-d1c6-48ab-831b-b98e80d293fa req-b3a509bf-df2c-4014-bdd0-4189ea03269b tempest-ServerActionsTestOtherA-1380515094 None] attachment_update completed successfully. Nov 06 21:18:35 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc" returned: 0 in 0.426s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b9a0b-89d1-4a38-9aba-e38dfcef4e9f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:35 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 Nov 06 21:18:35 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:36 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8" returned: 0 in 0.558s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f743d2f-8dda-441e-8293-7378f6f39efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c477a4d3-251e-45da-80d7-f8aff615e4a7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:36 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 Nov 06 21:18:36 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:36 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026" returned: 0 in 0.409s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f743d2f-8dda-441e-8293-7378f6f39efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc527253-007c-4cc0-b687-208c4c1f0473]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:36 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc Nov 06 21:18:36 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:37 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc" returned: 0 in 0.634s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:37 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 Nov 06 21:18:37 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Flow 'volume_create_manager' (f18a0cc3-1143-42ff-a170-28b7d8106db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6393f413-ae38-4866-9043-860421024891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6393f413-ae38-4866-9043-860421024891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1355518698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab82da-efde-4501-8a48-0604db40c2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c80fc551e246779788c971deab799e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:37Z,use_quota=True,user_id='d76c83c226c54c28ac7af62e44cb088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c251f394-f0ec-4f37-8d49-083722135b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c251f394-f0ec-4f37-8d49-083722135b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff45012-ac0e-4344-b56f-01d3ce625f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff45012-ac0e-4344-b56f-01d3ce625f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ab82da-efde-4501-8a48-0604db40c2f3', 'volume_name': 'volume-94ab82da-efde-4501-8a48-0604db40c2f3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ce210-e954-4800-b6b7-cccd045fa678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ce210-e954-4800-b6b7-cccd045fa678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97815a5-d1d1-4af6-bec7-b94fc33cc779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Volume 94ab82da-efde-4501-8a48-0604db40c2f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ab82da-efde-4501-8a48-0604db40c2f3', 'volume_size': 1} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1355518698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab82da-efde-4501-8a48-0604db40c2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c80fc551e246779788c971deab799e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:37Z,use_quota=True,user_id='d76c83c226c54c28ac7af62e44cb088c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Creating volume 94ab82da-efde-4501-8a48-0604db40c2f3 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:37 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:37 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 1073741824 Nov 06 21:18:37 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:37 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026" returned: 0 in 0.492s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:37 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026 Nov 06 21:18:37 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:38 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.24f782c6-a194-49b9-83ad-6012ce4af026" returned: 0 in 0.372s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 -F qcow2 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:38 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 -F qcow2 Nov 06 21:18:38 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:38 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 1073741824" returned: 0 in 0.639s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:38 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 Nov 06 21:18:38 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:38 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:38 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f743d2f-8dda-441e-8293-7378f6f39efc /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 -F qcow2" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3" returned: 0 in 0.304s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-24f782c6-a194-49b9-83ad-6012ce4af026" released by "_delete_snapshot" :: held 4.491s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" released by "delete_snapshot" :: held 4.531s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97815a5-d1d1-4af6-bec7-b94fc33cc779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ab82da-efde-4501-8a48-0604db40c2f3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30eac2b-85bf-4b7d-aad9-abd0e6e1678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Volume volume-94ab82da-efde-4501-8a48-0604db40c2f3 (94ab82da-efde-4501-8a48-0604db40c2f3): created successfully Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30eac2b-85bf-4b7d-aad9-abd0e6e1678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Flow 'volume_create_manager' (f18a0cc3-1143-42ff-a170-28b7d8106db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4625bcea-8b82-438e-8b99-5bc200900b1b tempest-ServersNegativeTestJSON-1056445255 None] Created volume successfully. Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Created reservations ['d0e360bb-df23-483a-8660-899e0cb2711c', '6b592899-7e80-4fdc-918f-6bbcd172b609', 'e0a35f1c-4fa3-4021-97f4-dd7ade537def', '86d347a3-fc09-459b-9164-7d4b3f7e2b9d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Delete snapshot completed successfully. Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-24f782c6-a194-49b9-83ad-6012ce4af026-delete_snapshot" released by "delete_snapshot" :: held 4.818s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-9ea49e19-b006-4423-a18a-0612fa2076f8-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-9ea49e19-b006-4423-a18a-0612fa2076f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-9ea49e19-b006-4423-a18a-0612fa2076f8" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-9ea49e19-b006-4423-a18a-0612fa2076f8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Deleting offline snapshot 9ea49e19-b006-4423-a18a-0612fa2076f8 of volume 7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:18:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] snapshot_file for this snap is: volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5730eadc-1efe-4e6d-a816-734c9f8837ab]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:39 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 Nov 06 21:18:39 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:39 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8" returned: 0 in 0.486s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f743d2f-8dda-441e-8293-7378f6f39efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5379f56-804c-4321-aebd-03b3d7b0a015]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:39 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc Nov 06 21:18:39 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "cinder-94ab82da-efde-4501-8a48-0604db40c2f3-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-94ab82da-efde-4501-8a48-0604db40c2f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "cinder-quobyte-94ab82da-efde-4501-8a48-0604db40c2f3" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-quobyte-94ab82da-efde-4501-8a48-0604db40c2f3" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:40 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[06762233-9209-4d73-afee-137740b3ff24]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc" returned: 0 in 0.496s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:40 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 Nov 06 21:18:40 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:40 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 Nov 06 21:18:40 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:40 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8" returned: 0 in 0.425s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:40 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:40 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8 Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3" returned: 0 in 0.475s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:40 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:40 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3 Nov 06 21:18:40 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:40 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc.9ea49e19-b006-4423-a18a-0612fa2076f8" returned: 0 in 0.374s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:40 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-94ab82da-efde-4501-8a48-0604db40c2f3" returned: 0 in 0.367s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-9ea49e19-b006-4423-a18a-0612fa2076f8" released by "_delete_snapshot" :: held 1.959s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-quobyte-94ab82da-efde-4501-8a48-0604db40c2f3" released by "delete_volume" :: held 0.895s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" released by "delete_snapshot" :: held 1.997s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Created reservations ['6c25f507-07ae-4da2-9138-c55535649335', '44844c99-3aad-4c78-816d-fcaf6da234da', '86def320-a494-415c-be67-2ec8890bcb1f', 'd14d61b6-a73c-4a38-84e4-7f51293333fa'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:40 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Created reservations ['9963b0ed-7d2d-4148-ac8c-17f2c3828775', '97cec994-31ce-41c0-a245-cf9a954de3e6', '2680f843-8a42-492d-a2bf-9a8046db6693', '10fb97d4-8507-4af4-80c5-c968a69f34af'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:41 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:18:41 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Delete snapshot completed successfully. Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-9ea49e19-b006-4423-a18a-0612fa2076f8-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Snapshots deleted, issuing volume delete {{(pid=87450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "cinder-ecd63332-44ff-4f06-9065-dada7377735f-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" acquired by "delete_volume" :: waited 0.046s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-ecd63332-44ff-4f06-9065-dada7377735f-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4af7b08-2240-4d3b-bc9f-053a5de50ffc]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "cinder-quobyte-ecd63332-44ff-4f06-9065-dada7377735f" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-quobyte-ecd63332-44ff-4f06-9065-dada7377735f" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4391c5-5dda-4a3c-aae1-859f5c4d2a31]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:41 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc Nov 06 21:18:41 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:41 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Deleted volume successfully. Nov 06 21:18:41 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f Nov 06 21:18:41 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-94ae8e36-6e88-4c29-930d-e948a7cbc8e1 tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-94ab82da-efde-4501-8a48-0604db40c2f3-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:41 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc" returned: 0 in 0.641s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:41 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc Nov 06 21:18:41 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:41 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f" returned: 0 in 0.585s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:42 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f Nov 06 21:18:42 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:42 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7f743d2f-8dda-441e-8293-7378f6f39efc" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-7f743d2f-8dda-441e-8293-7378f6f39efc" released by "delete_volume" :: held 1.090s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:42 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ecd63332-44ff-4f06-9065-dada7377735f" returned: 0 in 0.332s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-quobyte-ecd63332-44ff-4f06-9065-dada7377735f" released by "delete_volume" :: held 1.006s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Created reservations ['90a63104-3237-4fca-ba2c-960899cf3e89', '2734ac63-473d-4ddc-aed2-d5950b914f05', '0b6a7f90-9b4a-4f53-b840-5035afd2cb25', 'e0c35276-ea0a-4b4a-a1d3-523bf449ba02'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Created reservations ['f27b5f8b-c851-408d-aa7e-895ebe642ca5', 'ad002ff8-5ac4-4820-ae69-6a866083f2e1', '5842ceff-7961-4759-8e6e-a024e2ade265', '4a953508-8c80-483e-8aea-a41ff1a4cd86'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:42 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:18:42 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:42 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:18:42 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:42 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.268s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Deleted volume successfully. Nov 06 21:18:42 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d495bb69-cf09-4d92-a952-441fe3821e7c tempest-ServersNegativeTestJSON-1056445255 None] Lock "cinder-ecd63332-44ff-4f06-9065-dada7377735f-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.424s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Deleted volume successfully. Nov 06 21:18:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7cd7a5cc-a788-4b1e-9195-0ba44e4bc402 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-7f743d2f-8dda-441e-8293-7378f6f39efc-delete_volume" released by "delete_volume" :: held 9.108s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:43 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:18:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Flow 'volume_create_manager' (66a6e218-83b7-4a1e-84eb-933f13c4f79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9d8b1e-001b-4152-8e81-bb8fe6474073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9d8b1e-001b-4152-8e81-bb8fe6474073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-412852209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1c6a2b-09d2-4826-b058-b1775d6b2aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65095025f4ac48d89c70c2c1996b46fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:44Z,use_quota=True,user_id='e027f85c06e043de815ff79da387e255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8229fff9-302b-46e7-b082-cf463c284028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8229fff9-302b-46e7-b082-cf463c284028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b01b279-9fcd-4430-8cd9-56f61818706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b01b279-9fcd-4430-8cd9-56f61818706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1c6a2b-09d2-4826-b058-b1775d6b2aa4', 'volume_name': 'volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048789b1-0701-4bac-8b77-3c7f840227a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048789b1-0701-4bac-8b77-3c7f840227a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60db143a-3a39-4b1d-9eca-2bf612e020dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:44 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Volume 1e1c6a2b-09d2-4826-b058-b1775d6b2aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4', 'volume_size': 1} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-412852209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1c6a2b-09d2-4826-b058-b1775d6b2aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65095025f4ac48d89c70c2c1996b46fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:44Z,use_quota=True,user_id='e027f85c06e043de815ff79da387e255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Creating volume 1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:44 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:44 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 1073741824 Nov 06 21:18:44 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:44 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 1073741824" returned: 0 in 0.859s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:45 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 Nov 06 21:18:45 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:45 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" returned: 0 in 0.346s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60db143a-3a39-4b1d-9eca-2bf612e020dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094c506b-ef98-4993-8de6-1daf5c119004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Volume volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 (1e1c6a2b-09d2-4826-b058-b1775d6b2aa4): created successfully Nov 06 21:18:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094c506b-ef98-4993-8de6-1daf5c119004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Flow 'volume_create_manager' (66a6e218-83b7-4a1e-84eb-933f13c4f79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7a65397f-c4da-47e4-9739-3e5161cffe90 tempest-VolumesDeleteCascade-276203281 None] Created volume successfully. Nov 06 21:18:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Creating offline snapshot 821be6b5-e388-4c37-b343-55bc6cd0ac02 of volume 1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:18:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b18e7-6c20-4e2d-8a51-59a6e46d8e37]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:46 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 Nov 06 21:18:46 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:46 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" returned: 0 in 0.394s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:46 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 1G Nov 06 21:18:46 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:47 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 1G" returned: 0 in 0.492s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:47 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 Nov 06 21:18:47 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:47 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02" returned: 0 in 0.378s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:47 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 is being set with open permissions: ugo+rw Nov 06 21:18:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:47 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 Nov 06 21:18:47 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:47 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:47 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.info Nov 06 21:18:47 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:48 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.info" returned: 0 in 0.285s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:48 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.info is being set with open permissions: ugo+rw Nov 06 21:18:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:48 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.info Nov 06 21:18:48 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:48 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.info" returned: 0 in 0.299s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d24a1d3e-9b81-410e-b587-adc989c399a7 tempest-VolumesDeleteCascade-276203281 None] Create snapshot completed successfully Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Flow 'volume_create_manager' (4c49c975-b8a7-4058-8787-86452a01caac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80429f9-5cc9-4176-b4a4-9f7b58f2df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80429f9-5cc9-4176-b4a4-9f7b58f2df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-268948874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed75f75-cc68-4ac8-8177-7167596404f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65095025f4ac48d89c70c2c1996b46fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=821be6b5-e388-4c37-b343-55bc6cd0ac02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:50Z,use_quota=True,user_id='e027f85c06e043de815ff79da387e255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab19f87-66ad-4076-a66b-09ef9dea02b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab19f87-66ad-4076-a66b-09ef9dea02b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fd2546-ce33-4568-87e9-97ff3fc02094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fd2546-ce33-4568-87e9-97ff3fc02094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aed75f75-cc68-4ac8-8177-7167596404f9', 'volume_name': 'volume-aed75f75-cc68-4ac8-8177-7167596404f9', 'volume_size': 1, 'snapshot_id': '821be6b5-e388-4c37-b343-55bc6cd0ac02'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed2f9c4-bca1-4088-bdfa-acc7381b2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed2f9c4-bca1-4088-bdfa-acc7381b2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848f3b9f-4670-4447-bfa1-efd1818490a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:50 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Volume aed75f75-cc68-4ac8-8177-7167596404f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aed75f75-cc68-4ac8-8177-7167596404f9', 'volume_size': 1, 'snapshot_id': '821be6b5-e388-4c37-b343-55bc6cd0ac02'} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-821be6b5-e388-4c37-b343-55bc6cd0ac02-aed75f75-cc68-4ac8-8177-7167596404f9" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-821be6b5-e388-4c37-b343-55bc6cd0ac02-aed75f75-cc68-4ac8-8177-7167596404f9" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Creating volume aed75f75-cc68-4ac8-8177-7167596404f9 from snapshot 821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-aed75f75-cc68-4ac8-8177-7167596404f9" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-aed75f75-cc68-4ac8-8177-7167596404f9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] snapshot: 821be6b5-e388-4c37-b343-55bc6cd0ac02, volume: aed75f75-cc68-4ac8-8177-7167596404f9, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e35fb-3cd7-488f-a1c1-20fc312c4231]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:50 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 Nov 06 21:18:50 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:50 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02" returned: 0 in 0.508s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[981507f5-3237-41a7-8e04-3836d4493d1e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:51 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 Nov 06 21:18:51 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:51 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" returned: 0 in 0.581s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:18:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:18:51 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:18:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:51 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 Nov 06 21:18:51 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:58 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=87,cinder:UPDATE=74,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:58 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=70,cinder:SELECT=80,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-de450294-2dad-4a12-bdcc-5d1db08af25f req-2ec62b73-5cf3-4f6d-a458-8929f0f544ed tempest-AttachVolumeTestJSON-992854155 None] Terminate volume connection completed successfully. Nov 06 21:18:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-de450294-2dad-4a12-bdcc-5d1db08af25f req-2ec62b73-5cf3-4f6d-a458-8929f0f544ed tempest-AttachVolumeTestJSON-992854155 None] Deleting attachment e431c792-2be7-4d39-aeb8-4919de52688f. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:18:59 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9" returned: 0 in 8.509s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:59 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:18:59 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Converted 1024.00 MB image at 120.32 MB/s Nov 06 21:19:00 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 is being set with open permissions: ugo+rw Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:00 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 Nov 06 21:19:00 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:00 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-aed75f75-cc68-4ac8-8177-7167596404f9" released by "_copy_volume_from_snapshot" :: held 10.009s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-821be6b5-e388-4c37-b343-55bc6cd0ac02-aed75f75-cc68-4ac8-8177-7167596404f9" released by "_create_volume_from_snapshot" :: held 10.121s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.145s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848f3b9f-4670-4447-bfa1-efd1818490a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed75f75-cc68-4ac8-8177-7167596404f9', 'volume_size': 1, 'snapshot_id': '821be6b5-e388-4c37-b343-55bc6cd0ac02'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6828017a-7f6a-49a3-beee-8a6932a3108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Volume volume-aed75f75-cc68-4ac8-8177-7167596404f9 (aed75f75-cc68-4ac8-8177-7167596404f9): created successfully Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6828017a-7f6a-49a3-beee-8a6932a3108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Flow 'volume_create_manager' (4c49c975-b8a7-4058-8787-86452a01caac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-db107c1e-73c6-4016-9193-44bea45021c8 tempest-VolumesDeleteCascade-276203281 None] Created volume successfully. Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Performing cascade delete. {{(pid=87450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-821be6b5-e388-4c37-b343-55bc6cd0ac02-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-821be6b5-e388-4c37-b343-55bc6cd0ac02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-821be6b5-e388-4c37-b343-55bc6cd0ac02" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-821be6b5-e388-4c37-b343-55bc6cd0ac02" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Deleting offline snapshot 821be6b5-e388-4c37-b343-55bc6cd0ac02 of volume 1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] snapshot_file for this snap is: volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[39770fd0-8025-4b93-bfad-e004c71b1c94]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:02 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 Nov 06 21:19:02 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-d8c97cc7-588f-4fcc-8941-028c51b01e42 req-6f9614bc-e0b9-4546-aaea-139a4ca431e5 tempest-ServerActionsTestOtherA-1380515094 None] Terminate volume connection completed successfully. Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-d8c97cc7-588f-4fcc-8941-028c51b01e42 req-6f9614bc-e0b9-4546-aaea-139a4ca431e5 tempest-ServerActionsTestOtherA-1380515094 None] Deleting attachment 846dfc92-ebd6-409a-a84a-803b1e47af7c. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:19:02 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02" returned: 0 in 0.606s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8099ed86-c9dd-4448-b3ea-d1cad7bf706d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:02 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 Nov 06 21:19:02 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:03 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" returned: 0 in 0.887s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:03 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 Nov 06 21:19:03 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:04 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02" returned: 0 in 0.801s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:04 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02 Nov 06 21:19:04 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:05 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4.821be6b5-e388-4c37-b343-55bc6cd0ac02" returned: 0 in 0.702s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-821be6b5-e388-4c37-b343-55bc6cd0ac02" released by "_delete_snapshot" :: held 3.300s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" released by "delete_snapshot" :: held 3.349s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Created reservations ['47e1bcef-757f-428e-9c49-dd46f8dd3fe3', '50e1bffc-b065-413d-b461-b23ef38471dd', '47687e8a-8dd7-4a65-8622-015c3a4128a5', '50019e5c-f8bc-4523-b3b6-711f97306b88'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Delete snapshot completed successfully. Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-821be6b5-e388-4c37-b343-55bc6cd0ac02-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Snapshots deleted, issuing volume delete {{(pid=87450) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" acquired by "delete_volume" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[68968349-8256-468e-af79-8c6526306d65]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:05 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 Nov 06 21:19:05 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:06 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" returned: 0 in 0.844s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:06 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4 Nov 06 21:19:06 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:07 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" returned: 0 in 0.542s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4" released by "delete_volume" :: held 1.505s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Created reservations ['b6ff2f2c-b9ed-4a56-96ae-75bf0b958ff4', '0fec5da7-955e-4cf9-be94-c75386d8677e', 'b71d45fb-7c30-48e5-a349-08a8ce3dc8ac', '59355adf-a40b-4ad3-ab0c-ae7cb19b7f8b'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:07 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:19:07 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:07 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.545s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:07 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Deleted volume successfully. Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6485d238-a75c-4ee1-9279-7623af472cbd tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-1e1c6a2b-09d2-4826-b058-b1775d6b2aa4-delete_volume" released by "delete_volume" :: held 6.359s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-aed75f75-cc68-4ac8-8177-7167596404f9-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-aed75f75-cc68-4ac8-8177-7167596404f9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "cinder-quobyte-aed75f75-cc68-4ac8-8177-7167596404f9" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-aed75f75-cc68-4ac8-8177-7167596404f9" acquired by "delete_volume" :: waited 0.044s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d3afbf-a5f7-4c21-b2aa-2938d800b79e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:08 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 Nov 06 21:19:08 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:08 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9" returned: 0 in 0.565s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:09 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9 Nov 06 21:19:09 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:09 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aed75f75-cc68-4ac8-8177-7167596404f9" returned: 0 in 0.457s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-quobyte-aed75f75-cc68-4ac8-8177-7167596404f9" released by "delete_volume" :: held 1.111s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Created reservations ['564ca25c-efed-408f-86ef-31e042d667e8', '6aedd0bc-4c23-47a4-aff2-14119657c293', 'f66c63b8-7e18-4375-9879-2896887db11e', '36725a43-ec5c-458d-8b32-3bc476af31df'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:09 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:19:09 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:10 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.492s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:10 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Deleted volume successfully. Nov 06 21:19:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ed7d85e9-e36f-404f-83f6-6f13ef3157b5 tempest-VolumesDeleteCascade-276203281 None] Lock "cinder-aed75f75-cc68-4ac8-8177-7167596404f9-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:11 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:19:11 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:11 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.477s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:19:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Flow 'volume_create_manager' (f8064ab8-62bd-45c8-b3b6-88ec09ad8483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3c0a75-e6e8-45f5-a408-1a8ccf47645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3c0a75-e6e8-45f5-a408-1a8ccf47645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1278675301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671df832-f2a4-4de6-9815-1d219246bdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277230f13a7d48428810369ac3ad4f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:16Z,use_quota=True,user_id='068e96ed51f24f4da4afc0bb5f1415eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32f9179-0892-4848-8561-f144b4ac283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32f9179-0892-4848-8561-f144b4ac283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bcc9f3-3ea5-450e-a79c-d94f8e3d46b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bcc9f3-3ea5-450e-a79c-d94f8e3d46b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '671df832-f2a4-4de6-9815-1d219246bdcf', 'volume_name': 'volume-671df832-f2a4-4de6-9815-1d219246bdcf', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435cda4c-8f93-47c5-9de7-e00411036f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435cda4c-8f93-47c5-9de7-e00411036f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d793d6-84bf-44c0-8642-923cae66ae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Volume 671df832-f2a4-4de6-9815-1d219246bdcf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-671df832-f2a4-4de6-9815-1d219246bdcf', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:19:16 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Trying to clone 671df832-f2a4-4de6-9815-1d219246bdcf from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:19:17 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78daa09-aa02-46bf-89cb-051345c566b3]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Flow 'volume_create_manager' (3a70a3e5-822a-452a-babd-7f479a13819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c96cb4-8aa0-4882-8325-017b62279b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c96cb4-8aa0-4882-8325-017b62279b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-782530530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980dcde940b4524af313e8ae8b08803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:18Z,use_quota=True,user_id='e23dba501c0b49e3b99366ab5899cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f69651-62df-42a6-939c-1ff6dc808ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f69651-62df-42a6-939c-1ff6dc808ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad2fa9b-2414-45d5-b83a-9385f880e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad2fa9b-2414-45d5-b83a-9385f880e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d', 'volume_name': 'volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d', 'volume_size': 2}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007adf6d-ea5e-41c7-93e5-5a8036e9115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007adf6d-ea5e-41c7-93e5-5a8036e9115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8196e45-23a6-42bc-94f5-50d471d4426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:17 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Volume 9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d', 'volume_size': 2} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-782530530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980dcde940b4524af313e8ae8b08803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:18Z,use_quota=True,user_id='e23dba501c0b49e3b99366ab5899cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Creating volume 9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:18 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d 2147483648 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:18 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD Nov 06 21:19:18 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:18 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d 2147483648 Nov 06 21:19:18 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:18 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 is fetched for user 068e96ed51f24f4da4afc0bb5f1415eb. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e786e8-1c52-4ef1-a80f-4979878bffa2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:18 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD Nov 06 21:19:18 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:18 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d 2147483648" returned: 0 in 0.856s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:18 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:18 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d Nov 06 21:19:18 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:19 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d" returned: 0 in 0.266s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1278675301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671df832-f2a4-4de6-9815-1d219246bdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277230f13a7d48428810369ac3ad4f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:16Z,use_quota=True,user_id='068e96ed51f24f4da4afc0bb5f1415eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Creating volume 671df832-f2a4-4de6-9815-1d219246bdcf {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:19 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8196e45-23a6-42bc-94f5-50d471d4426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d', 'volume_size': 2}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfc5bdc-d973-4748-b970-e8a123d26e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:19 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf 1073741824 Nov 06 21:19:19 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:19 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Volume volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d (9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d): created successfully Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfc5bdc-d973-4748-b970-e8a123d26e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Flow 'volume_create_manager' (3a70a3e5-822a-452a-babd-7f479a13819d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:19 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-93e86338-ddb4-4a7a-bb7a-e19e5b794c6a tempest-VolumesCloneNegativeTest-1494039862 None] Created volume successfully. Nov 06 21:19:19 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf 1073741824" returned: 0 in 0.574s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:19 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf Nov 06 21:19:19 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:20 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Acquiring lock "cinder-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf" returned: 0 in 0.313s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Lock "cinder-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Attempting download of 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume 671df832-f2a4-4de6-9815-1d219246bdcf. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Acquiring lock "cinder-quobyte-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Lock "cinder-quobyte-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403fb92-cf93-48a2-ac2f-05313feb2839]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_jqi3_954 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3988dad-b4e6-43ab-9137-0b01a7648753]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:20 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d Nov 06 21:19:20 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:20 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_jqi3_954 Nov 06 21:19:20 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:20 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_jqi3_954" returned: 0 in 0.400s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_jqi3_954 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:20 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d" returned: 0 in 0.416s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:20 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d Nov 06 21:19:20 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:20 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_jqi3_954 Nov 06 21:19:20 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:21 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d" returned: 0 in 0.283s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Lock "cinder-quobyte-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d" released by "delete_volume" :: held 0.767s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:21 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_jqi3_954" returned: 1 in 0.372s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_jqi3_954' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7bf5de-c0d2-484b-9bff-5a4c2381a15c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Created reservations ['b8bff062-7b31-4788-b14c-471cf5f76289', 'ae8021a7-c328-4410-9114-a1121fbc27fe', '0b7e42f4-bab6-4e52-b614-eb24427d439e', 'ea54ee07-9f39-467d-97ce-1cfe5ad0505c'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:21 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD Nov 06 21:19:21 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:21 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:19:21 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:21 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.311s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Deleted volume successfully. Nov 06 21:19:21 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] 8c7c38c6-44d6-4400-a543-dd1512f9cf56 was qcow2, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f80405fb-5d20-478d-9377-76538051f581 tempest-VolumesCloneNegativeTest-1494039862 None] Lock "cinder-9d2a5a2e-16e1-4d09-b8f2-96ee55968a5d-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:21 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf Nov 06 21:19:21 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:24 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf" returned: 0 in 2.531s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_xqgeushudevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:19:24 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Converted 112.00 MB image at 44.24 MB/s Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:24 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf 1G Nov 06 21:19:24 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:24 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf 1G" returned: 0 in 0.383s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Downloaded image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume 671df832-f2a4-4de6-9815-1d219246bdcf successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 for user 068e96ed51f24f4da4afc0bb5f1415eb is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Marking volume 671df832-f2a4-4de6-9815-1d219246bdcf as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Copying metadata from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 to 671df832-f2a4-4de6-9815-1d219246bdcf. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Creating volume glance metadata for volume 671df832-f2a4-4de6-9815-1d219246bdcf backed by image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d793d6-84bf-44c0-8642-923cae66ae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671df832-f2a4-4de6-9815-1d219246bdcf', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b0805a-4801-4ad3-86ce-1d4738926ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Volume volume-671df832-f2a4-4de6-9815-1d219246bdcf (671df832-f2a4-4de6-9815-1d219246bdcf): created successfully Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b0805a-4801-4ad3-86ce-1d4738926ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Flow 'volume_create_manager' (f8064ab8-62bd-45c8-b3b6-88ec09ad8483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5230363b-b223-440f-b49b-53ee612cfbd8 tempest-ServerActionsTestOtherA-1380515094 None] Created volume successfully. Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (8711509c-fb60-4559-89f3-2d1ebda5fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8885a-3a66-4a88-b41a-77c06880b8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8885a-3a66-4a88-b41a-77c06880b8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-901712086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244a159e-4cb7-4819-8292-b79d67d725b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:27Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403cabf1-a1aa-463f-b000-c4c8e47dd45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403cabf1-a1aa-463f-b000-c4c8e47dd45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be92f2d-6434-4700-bca4-8d11ac9f1194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be92f2d-6434-4700-bca4-8d11ac9f1194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244a159e-4cb7-4819-8292-b79d67d725b1', 'volume_name': 'volume-244a159e-4cb7-4819-8292-b79d67d725b1', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f590218-e0ae-47cd-a9e4-f5064b781ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f590218-e0ae-47cd-a9e4-f5064b781ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fee212-b936-4d22-b294-3542dbc44fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:27 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Volume 244a159e-4cb7-4819-8292-b79d67d725b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244a159e-4cb7-4819-8292-b79d67d725b1', 'volume_size': 1} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-901712086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244a159e-4cb7-4819-8292-b79d67d725b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:27Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Creating volume 244a159e-4cb7-4819-8292-b79d67d725b1 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:27 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:19:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:27 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 1073741824 Nov 06 21:19:27 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:28 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 1073741824" returned: 0 in 0.830s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:28 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 Nov 06 21:19:28 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:28 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1" returned: 0 in 0.373s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fee212-b936-4d22-b294-3542dbc44fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244a159e-4cb7-4819-8292-b79d67d725b1', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f070265e-74cc-420d-a76f-9960822bce39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Volume volume-244a159e-4cb7-4819-8292-b79d67d725b1 (244a159e-4cb7-4819-8292-b79d67d725b1): created successfully Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f070265e-74cc-420d-a76f-9960822bce39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (8711509c-fb60-4559-89f3-2d1ebda5fb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c48d271e-5ac1-41ee-bd6a-bee244f11ec9 tempest-VolumesGetTest-1038741502 None] Created volume successfully. Nov 06 21:19:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b9fb7f4f-8853-44ba-ad28-874deef52f59 req-00bb8544-6eea-4c40-b7cf-782f23d8ff40 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b9fb7f4f-8853-44ba-ad28-874deef52f59 req-00bb8544-6eea-4c40-b7cf-782f23d8ff40 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b9fb7f4f-8853-44ba-ad28-874deef52f59 req-00bb8544-6eea-4c40-b7cf-782f23d8ff40 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b9fb7f4f-8853-44ba-ad28-874deef52f59 req-00bb8544-6eea-4c40-b7cf-782f23d8ff40 tempest-ServerActionsTestOtherA-1380515094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-671df832-f2a4-4de6-9815-1d219246bdcf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c51687f8-bdad-4e1b-8985-14e06d8af04a', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:19:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-b9fb7f4f-8853-44ba-ad28-874deef52f59 req-00bb8544-6eea-4c40-b7cf-782f23d8ff40 tempest-ServerActionsTestOtherA-1380515094 None] attachment_update completed successfully. Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (cf30ed64-934b-472f-b125-c8c838d942a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28e33d-15f6-4cf1-acc1-2c6842f0d2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28e33d-15f6-4cf1-acc1-2c6842f0d2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876882613',display_name='tempest-VolumesGetTest-Volume-1724414922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac32256-eaa4-41ba-806b-972cf8990e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:31Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89315a4-4b21-48e9-b276-d51147855703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89315a4-4b21-48e9-b276-d51147855703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fbe9a9-12db-48f0-b768-2c0d49d1e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fbe9a9-12db-48f0-b768-2c0d49d1e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac32256-eaa4-41ba-806b-972cf8990e5c', 'volume_name': 'volume-3ac32256-eaa4-41ba-806b-972cf8990e5c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8a0a9f-aa9b-4cde-88fc-e6cef8a976b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8a0a9f-aa9b-4cde-88fc-e6cef8a976b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913e46aa-a42b-4795-a3c7-0028b249368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:30 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Volume 3ac32256-eaa4-41ba-806b-972cf8990e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac32256-eaa4-41ba-806b-972cf8990e5c', 'volume_size': 1} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876882613',display_name='tempest-VolumesGetTest-Volume-1724414922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac32256-eaa4-41ba-806b-972cf8990e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:31Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Creating volume 3ac32256-eaa4-41ba-806b-972cf8990e5c {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:30 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:19:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:31 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c 1073741824 Nov 06 21:19:31 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:31 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c 1073741824" returned: 0 in 0.857s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:31 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c Nov 06 21:19:31 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:32 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c" returned: 0 in 0.329s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913e46aa-a42b-4795-a3c7-0028b249368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac32256-eaa4-41ba-806b-972cf8990e5c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ebda38-1813-4ad6-829b-c36e3f63ad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Volume volume-3ac32256-eaa4-41ba-806b-972cf8990e5c (3ac32256-eaa4-41ba-806b-972cf8990e5c): created successfully Nov 06 21:19:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ebda38-1813-4ad6-829b-c36e3f63ad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (cf30ed64-934b-472f-b125-c8c838d942a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5de504af-01d1-46d4-9715-7de4de465a76 tempest-VolumesGetTest-1038741502 None] Created volume successfully. Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-3ac32256-eaa4-41ba-806b-972cf8990e5c-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-3ac32256-eaa4-41ba-806b-972cf8990e5c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-3ac32256-eaa4-41ba-806b-972cf8990e5c" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-3ac32256-eaa4-41ba-806b-972cf8990e5c" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2655fde-527a-4961-9b17-38abd2145ce4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:33 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c Nov 06 21:19:33 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:33 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c" returned: 0 in 0.663s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:33 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c Nov 06 21:19:33 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:34 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3ac32256-eaa4-41ba-806b-972cf8990e5c" returned: 0 in 0.605s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-3ac32256-eaa4-41ba-806b-972cf8990e5c" released by "delete_volume" :: held 1.376s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Created reservations ['19273080-0efa-4f52-ab95-7c89b0e96df7', 'b4a41b7d-8853-4062-9fef-aa34aba47f5a', 'e2d4b5e2-8d1a-40a5-b73f-16c4eb3ba05d', '64f2d43c-d703-451d-a606-a8528b36531e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:34 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:19:34 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:35 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.576s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:35 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Deleted volume successfully. Nov 06 21:19:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-af5b2b9b-d07c-4b95-911e-6f0227786fc9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-3ac32256-eaa4-41ba-806b-972cf8990e5c-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-244a159e-4cb7-4819-8292-b79d67d725b1-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Lock "cinder-244a159e-4cb7-4819-8292-b79d67d725b1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-244a159e-4cb7-4819-8292-b79d67d725b1" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-244a159e-4cb7-4819-8292-b79d67d725b1" acquired by "delete_volume" :: waited 0.042s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:36 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d7b7ad-6f82-437a-b916-7f727d0c3c02]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:36 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 Nov 06 21:19:36 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:36 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1" returned: 0 in 0.626s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:36 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1 Nov 06 21:19:36 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:37 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-244a159e-4cb7-4819-8292-b79d67d725b1" returned: 0 in 0.462s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-244a159e-4cb7-4819-8292-b79d67d725b1" released by "delete_volume" :: held 1.206s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Created reservations ['a94057f2-b40f-4de7-85c3-3885e5bc28c0', '8072f14f-ecda-405d-92e9-b27806b3fef4', '58d6d7c9-9165-4d8e-9ad1-2e6e01762e7e', '7ce08a4e-bea8-43ba-b3e5-362f94523932'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:37 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:19:37 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:38 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.868s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:38 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Deleted volume successfully. Nov 06 21:19:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eb468b8b-95b7-472c-a03b-b715bd820725 tempest-VolumesGetTest-1038741502 None] Lock "cinder-244a159e-4cb7-4819-8292-b79d67d725b1-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (4034284c-90b6-40ba-91f7-99cb8f17e6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac182a9-59fa-4f8a-92c6-4f34ed54b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac182a9-59fa-4f8a-92c6-4f34ed54b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-901457506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:39Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912f61d1-9861-4c5c-8a9a-05f1bcbfcabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912f61d1-9861-4c5c-8a9a-05f1bcbfcabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881988bd-24c6-4213-903e-39631a2654bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881988bd-24c6-4213-903e-39631a2654bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd', 'volume_name': 'volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c78cbde-13e5-46a8-9b01-22e261fee35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c78cbde-13e5-46a8-9b01-22e261fee35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a503520-165d-408a-8fa1-cdf7c85dfdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Volume 2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd', 'volume_size': 1} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-901457506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:39Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Creating volume 2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:39 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:19:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:39 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd 1073741824 Nov 06 21:19:39 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:40 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd 1073741824" returned: 0 in 1.086s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:40 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd Nov 06 21:19:40 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:41 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" returned: 0 in 0.414s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a503520-165d-408a-8fa1-cdf7c85dfdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7883d4a-7fad-4d96-8abe-34d90bc768c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:41 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Volume volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd (2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd): created successfully Nov 06 21:19:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7883d4a-7fad-4d96-8abe-34d90bc768c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (4034284c-90b6-40ba-91f7-99cb8f17e6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-583cdf35-fd70-48fa-b40f-536b9232d549 tempest-VolumesGetTest-1038741502 None] Created volume successfully. Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (a9324a55-925b-4a94-afd0-1dc4997d9eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81187a26-7402-4da7-9366-d7d607cc082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81187a26-7402-4da7-9366-d7d607cc082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1411318602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d476512-87f4-4ae8-b9e7-38296dd792f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:43Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ebec5b-f2e5-4f9c-ab0b-22fdbe010759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ebec5b-f2e5-4f9c-ab0b-22fdbe010759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749a38f3-9e67-4480-9a14-c1069586f1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749a38f3-9e67-4480-9a14-c1069586f1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d476512-87f4-4ae8-b9e7-38296dd792f7', 'volume_name': 'volume-4d476512-87f4-4ae8-b9e7-38296dd792f7', 'volume_size': 1, 'source_volid': '2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd', 'source_volstatus': 'available'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73af11a8-c352-47c0-9b90-5c2f4180c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73af11a8-c352-47c0-9b90-5c2f4180c519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426fc263-421f-443d-9491-17d6f8cf7a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:42 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Volume 4d476512-87f4-4ae8-b9e7-38296dd792f7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d476512-87f4-4ae8-b9e7-38296dd792f7', 'volume_size': 1, 'source_volid': '2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd', 'source_volstatus': 'available'} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:42 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Cloning volume 2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd to volume 4d476512-87f4-4ae8-b9e7-38296dd792f7 Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Creating offline snapshot 0645e867-127d-4a20-9dce-98f450c8c0a9 of volume 2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca4e39-ce6c-40fe-bdbb-e75b91f8acdb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:43 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd Nov 06 21:19:43 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:43 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" returned: 0 in 0.620s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:43 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 1G Nov 06 21:19:43 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:44 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 1G" returned: 0 in 0.838s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:44 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 Nov 06 21:19:44 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:44 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9" returned: 0 in 0.528s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:44 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 is being set with open permissions: ugo+rw Nov 06 21:19:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:45 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 Nov 06 21:19:45 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:45 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9" returned: 0 in 0.660s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:45 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.info Nov 06 21:19:45 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:46 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.info" returned: 0 in 0.437s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:46 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.info is being set with open permissions: ugo+rw Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:46 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.info Nov 06 21:19:46 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:46 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.info" returned: 0 in 0.675s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-4d476512-87f4-4ae8-b9e7-38296dd792f7" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-4d476512-87f4-4ae8-b9e7-38296dd792f7" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] snapshot: 0645e867-127d-4a20-9dce-98f450c8c0a9, volume: 4d476512-87f4-4ae8-b9e7-38296dd792f7, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f0813f-18e3-4ac9-8a55-3e19e83a8ee9]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:47 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 Nov 06 21:19:47 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:47 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9" returned: 0 in 0.744s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[36276e5b-727a-474c-bb88-38433aaaf31b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:48 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd Nov 06 21:19:48 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:48 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" returned: 0 in 0.727s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:19:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:19:48 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:19:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:48 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 Nov 06 21:19:48 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Flow 'volume_create_manager' (6e54b018-f96f-48f9-8f8a-158af4b620bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b7d5e0-7255-4aaa-949f-c19fc505b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b7d5e0-7255-4aaa-949f-c19fc505b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-663117990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4877c8f1-868e-4465-8b88-d6739887ac0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffacc39214441e79fa00a39cb57dc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:54Z,use_quota=True,user_id='2ac2a9cdd58548a2955b9ed940051dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a267b54d-1094-4ac7-a1a7-be406024113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a267b54d-1094-4ac7-a1a7-be406024113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57c39e3-35fc-48f8-b127-0e407e20ecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57c39e3-35fc-48f8-b127-0e407e20ecbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4877c8f1-868e-4465-8b88-d6739887ac0a', 'volume_name': 'volume-4877c8f1-868e-4465-8b88-d6739887ac0a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de771da4-f053-43fd-97d7-a438c72a2f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de771da4-f053-43fd-97d7-a438c72a2f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b4a120-5151-430f-a20f-51164162e1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Volume 4877c8f1-868e-4465-8b88-d6739887ac0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4877c8f1-868e-4465-8b88-d6739887ac0a', 'volume_size': 1} Nov 06 21:19:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:55 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-4af28119-1176-4fa6-9bf9-e112d5f2149d req-46a0f79e-acf1-4faf-a0bf-1a05d06ee3e4 tempest-ServerActionsTestOtherA-1380515094 None] Terminate volume connection completed successfully. Nov 06 21:19:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-4af28119-1176-4fa6-9bf9-e112d5f2149d req-46a0f79e-acf1-4faf-a0bf-1a05d06ee3e4 tempest-ServerActionsTestOtherA-1380515094 None] Deleting attachment c51687f8-bdad-4e1b-8985-14e06d8af04a. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=72,cinder:DELETE=6,cinder:SELECT=64,cinder:INSERT=22 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=64,cinder:INSERT=23,cinder:UPDATE=63,cinder:DELETE=5 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-4af28119-1176-4fa6-9bf9-e112d5f2149d req-fcd9bf21-cb87-4e5e-b789-1e6fa17eea5c tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:01 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7" returned: 0 in 12.927s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd, size 1024.00 MB, duration 12.93 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:20:01 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Converted 1024.00 MB image at 79.21 MB/s Nov 06 21:20:01 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 is being set with open permissions: ugo+rw Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:01 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 Nov 06 21:20:01 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:01 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7" returned: 0 in 0.266s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-4d476512-87f4-4ae8-b9e7-38296dd792f7" released by "_copy_volume_from_snapshot" :: held 14.870s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-0645e867-127d-4a20-9dce-98f450c8c0a9" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-0645e867-127d-4a20-9dce-98f450c8c0a9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Deleting offline snapshot 0645e867-127d-4a20-9dce-98f450c8c0a9 of volume 2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] snapshot_file for this snap is: volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34060e0-d745-41bf-8d95-4ab4e154cf13]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:02 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 Nov 06 21:20:02 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:02 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9" returned: 0 in 0.527s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd901897-7291-48c7-aef3-7b5644095212]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:02 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd Nov 06 21:20:02 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:02 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" returned: 0 in 0.547s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:03 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 Nov 06 21:20:03 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:03 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:03 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9 Nov 06 21:20:03 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:03 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd.0645e867-127d-4a20-9dce-98f450c8c0a9" returned: 0 in 0.383s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-0645e867-127d-4a20-9dce-98f450c8c0a9" released by "_delete_snapshot" :: held 1.997s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.925s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-663117990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4877c8f1-868e-4465-8b88-d6739887ac0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffacc39214441e79fa00a39cb57dc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:54Z,use_quota=True,user_id='2ac2a9cdd58548a2955b9ed940051dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Creating volume 4877c8f1-868e-4465-8b88-d6739887ac0a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:03 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426fc263-421f-443d-9491-17d6f8cf7a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d476512-87f4-4ae8-b9e7-38296dd792f7', 'volume_size': 1, 'source_volid': '2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd', 'source_volstatus': 'available'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:03 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a 1073741824 Nov 06 21:20:03 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7260e8-359f-4c41-b128-07726d5d939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:03 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Volume volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 (4d476512-87f4-4ae8-b9e7-38296dd792f7): created successfully Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7260e8-359f-4c41-b128-07726d5d939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (a9324a55-925b-4a94-afd0-1dc4997d9eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7a475971-fe45-4efe-9ca9-f43a266a4581 tempest-VolumesGetTest-1038741502 None] Created volume successfully. Nov 06 21:20:04 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a 1073741824" returned: 0 in 0.422s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:04 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a Nov 06 21:20:04 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:04 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a" returned: 0 in 0.267s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-4af28119-1176-4fa6-9bf9-e112d5f2149d req-fcd9bf21-cb87-4e5e-b789-1e6fa17eea5c tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.388s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-4af28119-1176-4fa6-9bf9-e112d5f2149d req-fcd9bf21-cb87-4e5e-b789-1e6fa17eea5c tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b4a120-5151-430f-a20f-51164162e1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4877c8f1-868e-4465-8b88-d6739887ac0a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125615c5-6262-41a7-b9a9-36e46b4a4a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:04 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Volume volume-4877c8f1-868e-4465-8b88-d6739887ac0a (4877c8f1-868e-4465-8b88-d6739887ac0a): created successfully Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125615c5-6262-41a7-b9a9-36e46b4a4a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Flow 'volume_create_manager' (6e54b018-f96f-48f9-8f8a-158af4b620bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-682fd2d3-50c9-4477-899c-ad5923a56a3e tempest-AttachVolumeShelveTestJSON-335492103 None] Created volume successfully. Nov 06 21:20:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-4af28119-1176-4fa6-9bf9-e112d5f2149d req-fcd9bf21-cb87-4e5e-b789-1e6fa17eea5c tempest-ServerActionsTestOtherA-1380515094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-671df832-f2a4-4de6-9815-1d219246bdcf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '492992f1-3707-4c66-9566-0c8358537217', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:20:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-4af28119-1176-4fa6-9bf9-e112d5f2149d req-fcd9bf21-cb87-4e5e-b789-1e6fa17eea5c tempest-ServerActionsTestOtherA-1380515094 None] attachment_update completed successfully. Nov 06 21:20:05 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:20:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (f33b47ae-a1fa-4447-a9b4-cf9f23b88948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1a2c7a-344f-40f9-8630-58bf20759998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1a2c7a-344f-40f9-8630-58bf20759998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-576008127',display_name='tempest-VolumesGetTest-Volume-1322740582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c38180-d70f-49c3-9427-a3d104a43705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:06Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a777e0b-80a8-4c0c-b507-02e163cd3359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a777e0b-80a8-4c0c-b507-02e163cd3359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67a279b-1fbc-4485-83da-0b6277e5049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67a279b-1fbc-4485-83da-0b6277e5049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c38180-d70f-49c3-9427-a3d104a43705', 'volume_name': 'volume-c6c38180-d70f-49c3-9427-a3d104a43705', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c837577-4b65-4308-b5d0-8532c7d12010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c837577-4b65-4308-b5d0-8532c7d12010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec203ba3-5306-415f-8395-9986c08e85bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Volume c6c38180-d70f-49c3-9427-a3d104a43705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c38180-d70f-49c3-9427-a3d104a43705', 'volume_size': 1} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-576008127',display_name='tempest-VolumesGetTest-Volume-1322740582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c38180-d70f-49c3-9427-a3d104a43705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:06Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Creating volume c6c38180-d70f-49c3-9427-a3d104a43705 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:06 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:20:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:06 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 1073741824 Nov 06 21:20:06 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:07 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 1073741824" returned: 0 in 0.928s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:07 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 Nov 06 21:20:07 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:07 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705" returned: 0 in 0.300s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec203ba3-5306-415f-8395-9986c08e85bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c38180-d70f-49c3-9427-a3d104a43705', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7e5a20-5b0f-4161-bbb7-76501513e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Volume volume-c6c38180-d70f-49c3-9427-a3d104a43705 (c6c38180-d70f-49c3-9427-a3d104a43705): created successfully Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7e5a20-5b0f-4161-bbb7-76501513e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (f33b47ae-a1fa-4447-a9b4-cf9f23b88948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-30a612fb-6ddd-48a9-acf2-9bc77e51465f tempest-VolumesGetTest-1038741502 None] Created volume successfully. Nov 06 21:20:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-c6c38180-d70f-49c3-9427-a3d104a43705-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Lock "cinder-c6c38180-d70f-49c3-9427-a3d104a43705-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-c6c38180-d70f-49c3-9427-a3d104a43705" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-c6c38180-d70f-49c3-9427-a3d104a43705" acquired by "delete_volume" :: waited 0.059s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:08 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dfd870-845a-494c-b2dd-8970b21d4359]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:08 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 Nov 06 21:20:08 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:09 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705" returned: 0 in 0.684s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:09 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705 Nov 06 21:20:09 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:09 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c6c38180-d70f-49c3-9427-a3d104a43705" returned: 0 in 0.636s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-c6c38180-d70f-49c3-9427-a3d104a43705" released by "delete_volume" :: held 1.453s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Created reservations ['7603c124-bc0f-4782-90ca-99e1d733bbb9', '0068e3e9-5db5-4158-b2c0-9f6b107d755a', '69432a58-7477-4c4f-b95b-796c7db7de17', 'd79350ab-e731-44d3-9482-be7af23dcee5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:10 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:10 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.428s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Deleted volume successfully. Nov 06 21:20:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce79fdce-709e-46f3-baee-404512d26c05 tempest-VolumesGetTest-1038741502 None] Lock "cinder-c6c38180-d70f-49c3-9427-a3d104a43705-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-4d476512-87f4-4ae8-b9e7-38296dd792f7-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:11 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:11 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-4d476512-87f4-4ae8-b9e7-38296dd792f7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-4d476512-87f4-4ae8-b9e7-38296dd792f7" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-4d476512-87f4-4ae8-b9e7-38296dd792f7" acquired by "delete_volume" :: waited 0.043s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d014f1-5739-42c1-906a-d716a7ac919d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:11 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.547s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:20:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:20:11 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 Nov 06 21:20:11 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:12 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7" returned: 0 in 0.858s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:12 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7 Nov 06 21:20:12 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:12 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4d476512-87f4-4ae8-b9e7-38296dd792f7" returned: 0 in 0.387s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-4d476512-87f4-4ae8-b9e7-38296dd792f7" released by "delete_volume" :: held 1.345s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Created reservations ['5a1aa623-640c-4544-894a-7bcdd4f4d872', '57e71527-da78-44c6-a498-4ca780c708d9', 'c28009db-0146-46ee-8bd8-69487298d9e9', 'dd8f1f8f-cd31-410e-84fb-d2fb0bc05988'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:13 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:13 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:13 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.488s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:13 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Deleted volume successfully. Nov 06 21:20:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4b7505c6-1bdd-4282-8084-f1843773b5a9 tempest-VolumesGetTest-1038741502 None] Lock "cinder-4d476512-87f4-4ae8-b9e7-38296dd792f7-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Lock "cinder-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[38748b18-5e6f-4ffa-8539-3ac8581fc15e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:14 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd Nov 06 21:20:14 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:14 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" returned: 0 in 0.529s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:14 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd Nov 06 21:20:14 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:14 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" returned: 0 in 0.305s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd" released by "delete_volume" :: held 0.974s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:14 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Created reservations ['3b810fef-990f-4b60-b8d3-f15666a8a1da', 'cc7f399d-d2a8-4a06-8926-8fc50fd43b94', 'aa08e783-b2a0-474b-aae8-fc476ff076c4', '06e90696-850d-436d-b944-67f2d8289b99'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:15 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:15 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:15 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.345s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:15 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Deleted volume successfully. Nov 06 21:20:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eeeefe26-7e20-47ea-b276-35d5d2ffdcce tempest-VolumesGetTest-1038741502 None] Lock "cinder-2c8ea0ee-4709-486c-a6f7-9b9e4fd2bcbd-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (0b97043a-64dc-4991-bbd1-b19a1fdfabe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331f95a8-b3bf-4788-828b-e047514ce77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331f95a8-b3bf-4788-828b-e047514ce77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-690235480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02b3512-6898-4d1a-8f8d-80994bfd79cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:17Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7542555-5616-4053-b299-686123082a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7542555-5616-4053-b299-686123082a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21646e5b-171c-4c04-96a9-e0692c798dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:17 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21646e5b-171c-4c04-96a9-e0692c798dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c02b3512-6898-4d1a-8f8d-80994bfd79cd', 'volume_name': 'volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d03a31d-0397-4aed-a825-6a8893402d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d03a31d-0397-4aed-a825-6a8893402d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c6da32-ef93-4ca5-9568-3d703bb6cdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:18 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Volume c02b3512-6898-4d1a-8f8d-80994bfd79cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Trying to clone c02b3512-6898-4d1a-8f8d-80994bfd79cd from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:20:18 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f7a495-a515-4ffe-a4ff-9bbfc1a6323e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:18 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD Nov 06 21:20:18 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:19 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 is fetched for user b6fc117e343f40658b28a40c007f3f99. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7f264b-269e-4b96-8a5f-9d22d571d109]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:19 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD Nov 06 21:20:19 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-6b7b4992-8c7d-428f-b89d-f362d3e46b89 req-f0538a13-1ad5-41f3-9c8a-2d35095f3fc1 tempest-AttachVolumeShelveTestJSON-335492103 None] No connector for attachment 3a9eefbf-1910-4c7d-a408-d0d8eba864e6; skipping storage backend terminate_connection call. {{(pid=87450) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-6b7b4992-8c7d-428f-b89d-f362d3e46b89 req-f0538a13-1ad5-41f3-9c8a-2d35095f3fc1 tempest-AttachVolumeShelveTestJSON-335492103 None] Deleting attachment 3a9eefbf-1910-4c7d-a408-d0d8eba864e6. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:20:19 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-690235480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02b3512-6898-4d1a-8f8d-80994bfd79cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:17Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Creating volume c02b3512-6898-4d1a-8f8d-80994bfd79cd {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:19 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:20:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:19 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd 1073741824 Nov 06 21:20:19 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:20 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd 1073741824" returned: 0 in 0.539s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:20 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd Nov 06 21:20:20 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:20 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd" returned: 0 in 0.309s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Attempting download of 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume c02b3512-6898-4d1a-8f8d-80994bfd79cd. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac01232d-350b-4acc-9d38-a176bb4f8e8b]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_h0k33lkv {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:20 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_h0k33lkv Nov 06 21:20:20 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:21 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_h0k33lkv" returned: 0 in 0.414s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_h0k33lkv {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:21 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_h0k33lkv Nov 06 21:20:21 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:21 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_h0k33lkv" returned: 1 in 0.411s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_h0k33lkv' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42e6a8e-5e5c-4f44-9fc8-6a1ad562fff4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:21 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD Nov 06 21:20:21 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:21 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] 8c7c38c6-44d6-4400-a543-dd1512f9cf56 was qcow2, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:20:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:21 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd Nov 06 21:20:21 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Flow 'volume_create_manager' (a7976f4a-f545-4c0a-b246-4f56bdc7d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b360e2f-300d-4b9b-9dc5-6e8f0cb22162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b360e2f-300d-4b9b-9dc5-6e8f0cb22162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2008403931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ac968d-3bdc-4c12-9273-4cf22277195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6517938a7d4f7cb32f813e323e0b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:23Z,use_quota=True,user_id='4c8ca8f590f24c99bda139bda22a4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f8bd62-596c-4514-a715-76bcaba17300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f8bd62-596c-4514-a715-76bcaba17300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03145ab-b534-47e2-8ba1-1b090eefd36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03145ab-b534-47e2-8ba1-1b090eefd36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ac968d-3bdc-4c12-9273-4cf22277195a', 'volume_name': 'volume-89ac968d-3bdc-4c12-9273-4cf22277195a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49c75bd-2daf-4776-8ce6-bd448ac1fb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49c75bd-2daf-4776-8ce6-bd448ac1fb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc62bb8c-6695-4198-8fdf-bb0c4c71c501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Volume 89ac968d-3bdc-4c12-9273-4cf22277195a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ac968d-3bdc-4c12-9273-4cf22277195a', 'volume_size': 1} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2008403931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ac968d-3bdc-4c12-9273-4cf22277195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6517938a7d4f7cb32f813e323e0b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:23Z,use_quota=True,user_id='4c8ca8f590f24c99bda139bda22a4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Creating volume 89ac968d-3bdc-4c12-9273-4cf22277195a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:22 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:20:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:22 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a 1073741824 Nov 06 21:20:22 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:23 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a 1073741824" returned: 0 in 0.695s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:23 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a Nov 06 21:20:23 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:24 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a" returned: 0 in 0.563s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc62bb8c-6695-4198-8fdf-bb0c4c71c501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ac968d-3bdc-4c12-9273-4cf22277195a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d23f801-b801-4518-95e9-669e4e166867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Volume volume-89ac968d-3bdc-4c12-9273-4cf22277195a (89ac968d-3bdc-4c12-9273-4cf22277195a): created successfully Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d23f801-b801-4518-95e9-669e4e166867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Flow 'volume_create_manager' (a7976f4a-f545-4c0a-b246-4f56bdc7d480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6dbf3ab4-20aa-450b-829b-ee0ffb1a109e tempest-AttachVolumeTestJSON-992854155 None] Created volume successfully. Nov 06 21:20:24 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd" returned: 0 in 2.995s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_7iai_b8wdevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:20:24 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Converted 112.00 MB image at 37.36 MB/s Nov 06 21:20:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:24 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd 1G Nov 06 21:20:24 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:25 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd 1G" returned: 0 in 0.752s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Downloaded image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume c02b3512-6898-4d1a-8f8d-80994bfd79cd successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 for user b6fc117e343f40658b28a40c007f3f99 is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Marking volume c02b3512-6898-4d1a-8f8d-80994bfd79cd as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Copying metadata from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 to c02b3512-6898-4d1a-8f8d-80994bfd79cd. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Creating volume glance metadata for volume c02b3512-6898-4d1a-8f8d-80994bfd79cd backed by image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c6da32-ef93-4ca5-9568-3d703bb6cdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfae897-ea13-43f5-8d33-b12d302f5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Volume volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd (c02b3512-6898-4d1a-8f8d-80994bfd79cd): created successfully Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfae897-ea13-43f5-8d33-b12d302f5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (0b97043a-64dc-4991-bbd1-b19a1fdfabe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-aa861683-0029-4539-8290-9f95ca678f11 tempest-VolumesGetTest-1038741502 None] Created volume successfully. Nov 06 21:20:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-08f003f9-f41f-4ee5-b1f9-53cd48edd4d5 req-114140ec-b185-4a0e-ab08-205f0fac1369 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-08f003f9-f41f-4ee5-b1f9-53cd48edd4d5 req-114140ec-b185-4a0e-ab08-205f0fac1369 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-08f003f9-f41f-4ee5-b1f9-53cd48edd4d5 req-114140ec-b185-4a0e-ab08-205f0fac1369 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-08f003f9-f41f-4ee5-b1f9-53cd48edd4d5 req-114140ec-b185-4a0e-ab08-205f0fac1369 tempest-AttachVolumeTestJSON-992854155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-89ac968d-3bdc-4c12-9273-4cf22277195a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b99809b-2694-4079-ac43-c2804103a487', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:20:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-08f003f9-f41f-4ee5-b1f9-53cd48edd4d5 req-114140ec-b185-4a0e-ab08-205f0fac1369 tempest-AttachVolumeTestJSON-992854155 None] attachment_update completed successfully. Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (fda22655-076d-47cb-9520-9ada9dea9c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5d89fc-e80d-4991-8532-e035d782a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5d89fc-e80d-4991-8532-e035d782a959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499318763',display_name='tempest-VolumesGetTest-Volume-1181820797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e5f916-cb0a-498a-8bf7-ce82bdbdca06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:27Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac42440b-0ae6-4208-ba73-4e903a8595c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac42440b-0ae6-4208-ba73-4e903a8595c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0f0b54-b330-4fc3-b983-cb0654798af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0f0b54-b330-4fc3-b983-cb0654798af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e5f916-cb0a-498a-8bf7-ce82bdbdca06', 'volume_name': 'volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f46b611-4ac5-4020-abab-5b5c044a9129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f46b611-4ac5-4020-abab-5b5c044a9129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23a4500-e68b-4b3b-b367-4b9e6994db6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:27 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Volume 37e5f916-cb0a-498a-8bf7-ce82bdbdca06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06', 'volume_size': 1} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499318763',display_name='tempest-VolumesGetTest-Volume-1181820797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e5f916-cb0a-498a-8bf7-ce82bdbdca06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debd27bcfb4e4aeba0bace174e45b283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:27Z,use_quota=True,user_id='b6fc117e343f40658b28a40c007f3f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Creating volume 37e5f916-cb0a-498a-8bf7-ce82bdbdca06 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:27 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:20:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:27 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 1073741824 Nov 06 21:20:27 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:28 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 1073741824" returned: 0 in 0.529s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:28 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 Nov 06 21:20:28 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:28 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06" returned: 0 in 0.369s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23a4500-e68b-4b3b-b367-4b9e6994db6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26682e8-d589-4e60-9056-bb57f13e701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Volume volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 (37e5f916-cb0a-498a-8bf7-ce82bdbdca06): created successfully Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26682e8-d589-4e60-9056-bb57f13e701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Flow 'volume_create_manager' (fda22655-076d-47cb-9520-9ada9dea9c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e7fff6fb-90ab-4956-851b-ab133fa9a69b tempest-VolumesGetTest-1038741502 None] Created volume successfully. Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Flow 'volume_create_manager' (2e8329e0-28df-4403-b18c-9abec688db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6265f25-f6fa-4ef3-8cbd-a2ff4739342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6265f25-f6fa-4ef3-8cbd-a2ff4739342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-130201488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ff34a9-7937-4e20-aafa-ea43b46636c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6517938a7d4f7cb32f813e323e0b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:29Z,use_quota=True,user_id='4c8ca8f590f24c99bda139bda22a4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0012ece4-27a9-4120-8b98-fd15326cbc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0012ece4-27a9-4120-8b98-fd15326cbc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02f8c22-1597-4aeb-977a-b489376bf877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02f8c22-1597-4aeb-977a-b489376bf877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ff34a9-7937-4e20-aafa-ea43b46636c8', 'volume_name': 'volume-87ff34a9-7937-4e20-aafa-ea43b46636c8', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20e5dbc-f043-4440-8615-f4148b25dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20e5dbc-f043-4440-8615-f4148b25dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859a4e8b-b946-40fe-bf88-23859bbee236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:29 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Volume 87ff34a9-7937-4e20-aafa-ea43b46636c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ff34a9-7937-4e20-aafa-ea43b46636c8', 'volume_size': 1} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-130201488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ff34a9-7937-4e20-aafa-ea43b46636c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6517938a7d4f7cb32f813e323e0b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:29Z,use_quota=True,user_id='4c8ca8f590f24c99bda139bda22a4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Creating volume 87ff34a9-7937-4e20-aafa-ea43b46636c8 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:29 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:29 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 1073741824 Nov 06 21:20:29 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:29 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 1073741824" returned: 0 in 0.453s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:29 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 Nov 06 21:20:29 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-37e5f916-cb0a-498a-8bf7-ce82bdbdca06-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Lock "cinder-37e5f916-cb0a-498a-8bf7-ce82bdbdca06-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-37e5f916-cb0a-498a-8bf7-ce82bdbdca06" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-37e5f916-cb0a-498a-8bf7-ce82bdbdca06" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25ac737-92f8-4089-85a2-92dd4b2f8f5d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:29 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 Nov 06 21:20:29 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:30 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8" returned: 0 in 0.439s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859a4e8b-b946-40fe-bf88-23859bbee236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ff34a9-7937-4e20-aafa-ea43b46636c8', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8050cab9-6b9f-44e0-9172-c14993ae7762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:30 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Volume volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 (87ff34a9-7937-4e20-aafa-ea43b46636c8): created successfully Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8050cab9-6b9f-44e0-9172-c14993ae7762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Flow 'volume_create_manager' (2e8329e0-28df-4403-b18c-9abec688db5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2a0b9f7d-f836-4e71-9f84-7df82301c4be tempest-AttachVolumeTestJSON-992854155 None] Created volume successfully. Nov 06 21:20:30 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06" returned: 0 in 0.430s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:30 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06 Nov 06 21:20:30 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:30 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37e5f916-cb0a-498a-8bf7-ce82bdbdca06" returned: 0 in 0.274s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-37e5f916-cb0a-498a-8bf7-ce82bdbdca06" released by "delete_volume" :: held 0.782s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Created reservations ['70abfad4-a621-4c6f-803d-208c2dbd3ead', '2ed93891-de11-4f47-8453-ce3629425c11', '75f535f7-6090-4ce0-8f83-1c2231054ab6', '89a8866c-ac02-456b-9022-12de21aa865e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:30 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:30 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-c02b3512-6898-4d1a-8f8d-80994bfd79cd-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Lock "cinder-c02b3512-6898-4d1a-8f8d-80994bfd79cd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:31 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.630s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Acquiring lock "cinder-quobyte-c02b3512-6898-4d1a-8f8d-80994bfd79cd" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Deleted volume successfully. Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-c02b3512-6898-4d1a-8f8d-80994bfd79cd" acquired by "delete_volume" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fb0a31a-6204-45f4-812b-5ceb1fb530d7 tempest-VolumesGetTest-1038741502 None] Lock "cinder-37e5f916-cb0a-498a-8bf7-ce82bdbdca06-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c281a0b-ce5f-43ef-9773-76dca1b27a36]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:31 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd Nov 06 21:20:31 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:32 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd" returned: 0 in 0.721s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:32 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd Nov 06 21:20:32 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-6311c826-30c0-4e66-a6a2-fef02e88f903 req-b63a99a6-2e78-4eb1-b2a6-b62786b20f9f tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-6311c826-30c0-4e66-a6a2-fef02e88f903 req-b63a99a6-2e78-4eb1-b2a6-b62786b20f9f tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-6311c826-30c0-4e66-a6a2-fef02e88f903 req-b63a99a6-2e78-4eb1-b2a6-b62786b20f9f tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:32 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c02b3512-6898-4d1a-8f8d-80994bfd79cd" returned: 0 in 0.336s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-6311c826-30c0-4e66-a6a2-fef02e88f903 req-b63a99a6-2e78-4eb1-b2a6-b62786b20f9f tempest-AttachVolumeTestJSON-992854155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-87ff34a9-7937-4e20-aafa-ea43b46636c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cc7a659-8faa-4c99-a564-19eafb76e39b', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Lock "cinder-quobyte-c02b3512-6898-4d1a-8f8d-80994bfd79cd" released by "delete_volume" :: held 1.204s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Created reservations ['5d4e281e-208e-4939-af74-26bb5da14340', '837e6659-0a49-465e-9dbb-de8e4fb4a67c', '13212bf7-4354-4a9f-81c5-59f9255797b0', '9e651ffc-54fe-4abf-a9c1-191f1ba9d94e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-6311c826-30c0-4e66-a6a2-fef02e88f903 req-b63a99a6-2e78-4eb1-b2a6-b62786b20f9f tempest-AttachVolumeTestJSON-992854155 None] attachment_update completed successfully. Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:33 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:33 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:33 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:33 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Deleted volume successfully. Nov 06 21:20:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6976f87e-3d35-4dde-a889-062d61c92e5a tempest-VolumesGetTest-1038741502 None] Lock "cinder-c02b3512-6898-4d1a-8f8d-80994bfd79cd-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-c670db51-bf83-4b7f-96d0-b899e1a7f26f req-f28f5e26-5ab3-4521-b1ef-6c0ddbf6383b tempest-AttachVolumeTestJSON-992854155 None] Terminate volume connection completed successfully. Nov 06 21:20:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-c670db51-bf83-4b7f-96d0-b899e1a7f26f req-f28f5e26-5ab3-4521-b1ef-6c0ddbf6383b tempest-AttachVolumeTestJSON-992854155 None] Deleting attachment 4b99809b-2694-4079-ac43-c2804103a487. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:20:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-fbb10c50-cdab-4b40-ba01-e355206a748d req-8b747056-f920-4722-a2ca-cbde57c3bd79 tempest-AttachVolumeTestJSON-992854155 None] Terminate volume connection completed successfully. Nov 06 21:20:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-fbb10c50-cdab-4b40-ba01-e355206a748d req-8b747056-f920-4722-a2ca-cbde57c3bd79 tempest-AttachVolumeTestJSON-992854155 None] Deleting attachment 0cc7a659-8faa-4c99-a564-19eafb76e39b. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Flow 'volume_create_manager' (5d9d985f-e66f-41db-9c5b-8bf05793c97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243fc4f3-7092-4eff-84de-9bc375bb95d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243fc4f3-7092-4eff-84de-9bc375bb95d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-958276673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d765a936-9d7b-4c94-923e-e5e95d36f00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563c1d8cd15d498ea5503b5fffb57c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:39Z,use_quota=True,user_id='c88bcc62c4094369a5ceb5bed1df58fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514d7749-4877-4668-bf07-d709a714e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514d7749-4877-4668-bf07-d709a714e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22994e8c-b9f9-47dd-bd42-624d006a6fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22994e8c-b9f9-47dd-bd42-624d006a6fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd765a936-9d7b-4c94-923e-e5e95d36f00a', 'volume_name': 'volume-d765a936-9d7b-4c94-923e-e5e95d36f00a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7206b2-c3f5-4e8f-a0cb-c5ab3b2fdf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7206b2-c3f5-4e8f-a0cb-c5ab3b2fdf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4a2d7f-f5b1-4d83-96c6-b0045b663a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Volume d765a936-9d7b-4c94-923e-e5e95d36f00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d765a936-9d7b-4c94-923e-e5e95d36f00a', 'volume_size': 1} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-958276673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d765a936-9d7b-4c94-923e-e5e95d36f00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563c1d8cd15d498ea5503b5fffb57c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:39Z,use_quota=True,user_id='c88bcc62c4094369a5ceb5bed1df58fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Creating volume d765a936-9d7b-4c94-923e-e5e95d36f00a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:38 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:20:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:38 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a 1073741824 Nov 06 21:20:38 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:39 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a 1073741824" returned: 0 in 0.947s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:39 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a Nov 06 21:20:39 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:40 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a" returned: 0 in 0.412s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4a2d7f-f5b1-4d83-96c6-b0045b663a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d765a936-9d7b-4c94-923e-e5e95d36f00a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6db082-bb08-411e-8062-7a463a2390d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Volume volume-d765a936-9d7b-4c94-923e-e5e95d36f00a (d765a936-9d7b-4c94-923e-e5e95d36f00a): created successfully Nov 06 21:20:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6db082-bb08-411e-8062-7a463a2390d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Flow 'volume_create_manager' (5d9d985f-e66f-41db-9c5b-8bf05793c97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1a29cb30-0ebd-454f-94d2-7b1f6047145c tempest-VolumesNegativeTest-2021531159 None] Created volume successfully. Nov 06 21:20:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "cinder-87ff34a9-7937-4e20-aafa-ea43b46636c8-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-87ff34a9-7937-4e20-aafa-ea43b46636c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "cinder-quobyte-87ff34a9-7937-4e20-aafa-ea43b46636c8" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-quobyte-87ff34a9-7937-4e20-aafa-ea43b46636c8" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a66d288-d9ed-49dc-84ae-70c25fefe2bd]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:43 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 Nov 06 21:20:43 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:43 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8" returned: 0 in 0.540s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:43 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8 Nov 06 21:20:43 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:43 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-87ff34a9-7937-4e20-aafa-ea43b46636c8" returned: 0 in 0.332s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-quobyte-87ff34a9-7937-4e20-aafa-ea43b46636c8" released by "delete_volume" :: held 0.952s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Created reservations ['4ad343ea-c4d2-4047-9855-d9c36018c8cc', '4cad5d54-4963-443f-ace2-94b11b4c6657', '76ec30f4-b806-422c-b093-548f2f8adf17', '98d7b071-4761-4f0e-9e9e-4ae657784bd6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:44 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:44 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:44 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.271s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Deleted volume successfully. Nov 06 21:20:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-33015153-2f5c-4ac3-91c0-2be80b76b305 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-87ff34a9-7937-4e20-aafa-ea43b46636c8-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "cinder-89ac968d-3bdc-4c12-9273-4cf22277195a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-89ac968d-3bdc-4c12-9273-4cf22277195a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "cinder-quobyte-89ac968d-3bdc-4c12-9273-4cf22277195a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-quobyte-89ac968d-3bdc-4c12-9273-4cf22277195a" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[552e1e35-f341-49e6-9c96-74566ebf0362]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:45 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a Nov 06 21:20:45 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:45 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a" returned: 0 in 0.437s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:45 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a Nov 06 21:20:45 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:46 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-89ac968d-3bdc-4c12-9273-4cf22277195a" returned: 0 in 0.269s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-quobyte-89ac968d-3bdc-4c12-9273-4cf22277195a" released by "delete_volume" :: held 0.757s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Created reservations ['f77c4363-a189-4e02-9499-e7d442009e98', '15de72be-2967-47a2-b899-9d017c33c95b', '6ce308cf-079a-4dca-a53d-0d143559e80f', '4fd71d93-925e-4bed-bbec-b9232591dc48'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:46 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:46 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:46 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.305s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Deleted volume successfully. Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f1c5790-bf18-4a13-9251-5ac21f76b434 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-89ac968d-3bdc-4c12-9273-4cf22277195a-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "cinder-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "cinder-quobyte-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-quobyte-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5" acquired by "delete_volume" :: waited 0.053s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8e01e9-224b-452b-9ec7-494a2d13aff5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:47 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 Nov 06 21:20:47 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:47 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5" returned: 0 in 0.605s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:47 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5 Nov 06 21:20:47 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:48 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5" returned: 0 in 0.463s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-quobyte-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5" released by "delete_volume" :: held 1.168s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Created reservations ['8098e7cf-d473-439f-a2b8-44dec54e6353', 'ef67dfbb-5e82-43d0-916c-0950c8237d98', 'e771e0c3-7ffc-49e0-9862-3168d79b34a0', 'ee644fb1-fff5-43f0-9ecb-8ba87e3b559b'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:48 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:48 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:48 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.294s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Deleted volume successfully. Nov 06 21:20:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa08a831-1d48-44ba-a2b0-f5f7f6ee7dd0 tempest-AttachVolumeTestJSON-992854155 None] Lock "cinder-c4efdab1-b546-4cc0-8f6d-8c5f4f94cdc5-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:56 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-6e86e009-07ee-4060-85f3-2917b2d2d4f9 tempest-ServerActionsTestOtherA-1380515094 None] Terminate volume connection completed successfully. Nov 06 21:20:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-6e86e009-07ee-4060-85f3-2917b2d2d4f9 tempest-ServerActionsTestOtherA-1380515094 None] Deleting attachment 492992f1-3707-4c66-9566-0c8358537217. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:20:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "cinder-671df832-f2a4-4de6-9815-1d219246bdcf-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-671df832-f2a4-4de6-9815-1d219246bdcf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "cinder-quobyte-671df832-f2a4-4de6-9815-1d219246bdcf" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-quobyte-671df832-f2a4-4de6-9815-1d219246bdcf" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:56 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb3f20-bbb1-4329-98b6-3c2a0c300dba]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:56 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf Nov 06 21:20:56 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:57 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf" returned: 0 in 0.706s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:57 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf Nov 06 21:20:57 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "cinder-12597da7-b29a-409d-957c-6bc32e2e97ee-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:57 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-671df832-f2a4-4de6-9815-1d219246bdcf" returned: 0 in 0.561s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-12597da7-b29a-409d-957c-6bc32e2e97ee-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-quobyte-671df832-f2a4-4de6-9815-1d219246bdcf" released by "delete_volume" :: held 1.373s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "cinder-quobyte-12597da7-b29a-409d-957c-6bc32e2e97ee" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-quobyte-12597da7-b29a-409d-957c-6bc32e2e97ee" acquired by "delete_volume" :: waited 0.048s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e38b96-d540-439e-87c5-4e950a30005b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG cinder.quota [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Created reservations ['005a9bae-375b-40ae-a0c4-cde86d6ef1cb', '05751aaf-bc36-49c8-a23b-2ce1a631bcac', 'b009ea21-83a6-4deb-b25e-ec3e30f9ed1c', '4bcf4e36-51a4-442a-914b-279378b6d345'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:58 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:58 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:58 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee Nov 06 21:20:58 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:58 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.421s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG cinder.manager [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Deleted volume successfully. Nov 06 21:20:58 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee" returned: 0 in 0.584s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-d2edded1-30a9-4ed5-aa84-6f00416d8285 req-431a43d0-b827-455a-b48f-d9805755e796 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-671df832-f2a4-4de6-9815-1d219246bdcf-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:58 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee Nov 06 21:20:58 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:58 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-12597da7-b29a-409d-957c-6bc32e2e97ee" returned: 0 in 0.376s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-quobyte-12597da7-b29a-409d-957c-6bc32e2e97ee" released by "delete_volume" :: held 1.050s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Created reservations ['a4dc529e-85bc-48a2-8dc4-709d714e0b26', '4d70c7c2-247f-480e-8cb4-f1dd55b7c482', '0be8d16b-5be7-471d-94c2-10e5110151c2', 'f5df4315-1fb2-43a1-9394-bd2eac4d56e3'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:59 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:20:59 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:59 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.291s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Deleted volume successfully. Nov 06 21:20:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f2ea6047-8826-4cb7-bee8-66d8a305a710 tempest-ServerActionsTestOtherA-1380515094 None] Lock "cinder-12597da7-b29a-409d-957c-6bc32e2e97ee-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Acquiring lock "cinder-4877c8f1-868e-4465-8b88-d6739887ac0a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "cinder-4877c8f1-868e-4465-8b88-d6739887ac0a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Acquiring lock "cinder-quobyte-4877c8f1-868e-4465-8b88-d6739887ac0a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "cinder-quobyte-4877c8f1-868e-4465-8b88-d6739887ac0a" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d128ca3b-a0c4-4449-9e41-bf8f9b486ea8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:00 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a Nov 06 21:21:00 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:01 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a" returned: 0 in 0.604s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:01 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a Nov 06 21:21:01 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:01 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4877c8f1-868e-4465-8b88-d6739887ac0a" returned: 0 in 0.387s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "cinder-quobyte-4877c8f1-868e-4465-8b88-d6739887ac0a" released by "delete_volume" :: held 1.158s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=119,cinder:INSERT=34,cinder:DELETE=8,cinder:SELECT=98 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=103,cinder:SELECT=95,cinder:DELETE=10,cinder:INSERT=27 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Created reservations ['d1ed1d61-37d8-4ba5-9fbd-ad6bdff223c7', '19662fd0-fa56-41dc-acfe-792507f0a7bd', '0640f015-4a8d-4147-9c2e-d39fb4a55c49', 'edd92629-4833-4529-8f9f-94c24a216dee'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:01 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:21:01 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:02 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.336s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:02 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Deleted volume successfully. Nov 06 21:21:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1af9711b-30ad-4f46-bc51-b781a9be10b6 tempest-AttachVolumeShelveTestJSON-335492103 None] Lock "cinder-4877c8f1-868e-4465-8b88-d6739887ac0a-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Acquiring lock "cinder-d765a936-9d7b-4c94-923e-e5e95d36f00a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Lock "cinder-d765a936-9d7b-4c94-923e-e5e95d36f00a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Acquiring lock "cinder-quobyte-d765a936-9d7b-4c94-923e-e5e95d36f00a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Lock "cinder-quobyte-d765a936-9d7b-4c94-923e-e5e95d36f00a" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a486e83f-1928-4a5b-9758-3a949faf2cab]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:03 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a Nov 06 21:21:03 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:03 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a" returned: 0 in 0.518s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:03 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a Nov 06 21:21:03 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:04 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d765a936-9d7b-4c94-923e-e5e95d36f00a" returned: 0 in 0.314s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Lock "cinder-quobyte-d765a936-9d7b-4c94-923e-e5e95d36f00a" released by "delete_volume" :: held 0.894s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Created reservations ['1b6fd69e-9f7d-4eb2-8a0a-4c7d3aeb982c', 'bf9d88fd-47a2-4600-b437-10ecb8917c3d', 'd57afc03-1326-4391-b587-e1095c378b68', 'b811d715-1565-4435-88da-86220fb84d45'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:04 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:21:04 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:04 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.257s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Deleted volume successfully. Nov 06 21:21:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-891c67db-3be6-434a-83b7-f97acfbb74f2 tempest-VolumesNegativeTest-2021531159 None] Lock "cinder-d765a936-9d7b-4c94-923e-e5e95d36f00a-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:21:11 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cf20e1d1-fcea-4371-b5e4-83af2e1e4b8d tempest-BackendsCapabilitiesAdminTestsJSON-360301559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87450) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 21:21:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d1015072-c0c4-4203-ba95-a4e096f03681 tempest-BackendsCapabilitiesAdminTestsJSON-360301559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87450) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 21:21:14 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:14 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:INSERT=4,cinder:UPDATE=18,cinder:SELECT=5,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Flow 'volume_create_manager' (40105037-11a8-4bc3-8a78-eb007cdaea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f5c226-0d78-4b4f-94de-76847262f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f5c226-0d78-4b4f-94de-76847262f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-648278557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ca71f3-d6e6-46ba-a701-7ebce6434ecc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0482d4f7a98d4ebebc7f255d4a8c5184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:15Z,use_quota=True,user_id='4afc9d4726da4083af8329ca1eeba4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788fecc0-d740-405c-9624-3331a5d13508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788fecc0-d740-405c-9624-3331a5d13508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab7391f-eb33-461b-a636-90b23ab9b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab7391f-eb33-461b-a636-90b23ab9b533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ca71f3-d6e6-46ba-a701-7ebce6434ecc', 'volume_name': 'volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa1434-ad54-4d59-9df4-e51b98661cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa1434-ad54-4d59-9df4-e51b98661cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4357c8a5-c1e6-4032-a3ea-f982b72619ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:15 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Volume 41ca71f3-d6e6-46ba-a701-7ebce6434ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc', 'volume_size': 1} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-648278557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ca71f3-d6e6-46ba-a701-7ebce6434ecc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0482d4f7a98d4ebebc7f255d4a8c5184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:15Z,use_quota=True,user_id='4afc9d4726da4083af8329ca1eeba4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Creating volume 41ca71f3-d6e6-46ba-a701-7ebce6434ecc {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:15 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:21:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:15 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc 1073741824 Nov 06 21:21:15 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:16 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc 1073741824" returned: 0 in 0.563s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:16 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc Nov 06 21:21:16 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:16 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4357c8a5-c1e6-4032-a3ea-f982b72619ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c318761-9d7b-4800-9edb-2cd373a57525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Volume volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc (41ca71f3-d6e6-46ba-a701-7ebce6434ecc): created successfully Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c318761-9d7b-4800-9edb-2cd373a57525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Flow 'volume_create_manager' (40105037-11a8-4bc3-8a78-eb007cdaea57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-b16f4392-7472-4a81-a69d-5f9fa412a028 req-deb8123c-e24d-4b89-a19d-d68c5188e250 tempest-VolumesGetTestJSON-1662369432 None] Created volume successfully. Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Acquiring lock "cinder-41ca71f3-d6e6-46ba-a701-7ebce6434ecc-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Lock "cinder-41ca71f3-d6e6-46ba-a701-7ebce6434ecc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Acquiring lock "cinder-quobyte-41ca71f3-d6e6-46ba-a701-7ebce6434ecc" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Lock "cinder-quobyte-41ca71f3-d6e6-46ba-a701-7ebce6434ecc" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e01940-9c2b-4b3b-9365-30102f390e0d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:18 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc Nov 06 21:21:18 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:18 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc" returned: 0 in 0.536s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:18 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc Nov 06 21:21:18 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:19 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-41ca71f3-d6e6-46ba-a701-7ebce6434ecc" returned: 0 in 0.386s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Lock "cinder-quobyte-41ca71f3-d6e6-46ba-a701-7ebce6434ecc" released by "delete_volume" :: held 1.005s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG cinder.quota [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Created reservations ['e8ccea5e-b8a2-478b-9be2-68199f4b402c', '0ee8a704-1175-4185-9685-ce2d85b658d1', '299620e0-3546-4983-bd1a-6ac157c36f19', '3ee20b0b-306c-4ac8-a8bf-bbb905b9d0eb'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:19 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:21:19 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:19 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.325s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG cinder.manager [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:19 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Deleted volume successfully. Nov 06 21:21:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-6f6bcca3-5e71-4ebf-a739-b43bee5e4552 req-a60dd34f-0e42-45fd-9aab-446d3d758139 tempest-VolumesGetTestJSON-1662369432 None] Lock "cinder-41ca71f3-d6e6-46ba-a701-7ebce6434ecc-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-14ac4488-f9d1-4a72-827e-1f10403503bf tempest-GroupSnapshotsTest-1575930250 None] Group tempest-GroupSnapshotsTest-Group-769706279: creating Nov 06 21:21:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-14ac4488-f9d1-4a72-827e-1f10403503bf tempest-GroupSnapshotsTest-1575930250 None] Group tempest-GroupSnapshotsTest-Group-769706279: created successfully Nov 06 21:21:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-14ac4488-f9d1-4a72-827e-1f10403503bf tempest-GroupSnapshotsTest-1575930250 None] Create group completed successfully. Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (4d4ad182-736d-4180-8bbb-01187295fcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cda0ae-ddbc-4576-95b6-fb6bcb44496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cda0ae-ddbc-4576-95b6-fb6bcb44496c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991084787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de9a7e62-6af7-4470-a0ed-88978ee3508f,host='devstack@QuobyteHD#QuobyteHD',id=1abcb110-9e8f-4d56-bed4-cd8f0cb3757e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:25Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99e80b77-1c92-43a2-8c2a-487390f67923),volume_type_id=99e80b77-1c92-43a2-8c2a-487390f67923)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f761fc4f-dd13-4744-b5dc-a5f775aea5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f761fc4f-dd13-4744-b5dc-a5f775aea5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c686a150-6ac4-42af-b28d-313684080d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c686a150-6ac4-42af-b28d-313684080d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1abcb110-9e8f-4d56-bed4-cd8f0cb3757e', 'volume_name': 'volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e462d4b6-281b-4aa2-b7f3-3289c9022107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e462d4b6-281b-4aa2-b7f3-3289c9022107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9506d4e-31bd-47b0-9a14-914fe5ae7dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Volume 1abcb110-9e8f-4d56-bed4-cd8f0cb3757e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e', 'volume_size': 1} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=de9a7e62-6af7-4470-a0ed-88978ee3508f,created_at=2026-11-06T20:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991084787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de9a7e62-6af7-4470-a0ed-88978ee3508f,host='devstack@QuobyteHD#QuobyteHD',id=1abcb110-9e8f-4d56-bed4-cd8f0cb3757e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:25Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99e80b77-1c92-43a2-8c2a-487390f67923),volume_type_id=99e80b77-1c92-43a2-8c2a-487390f67923)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Creating volume 1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:24 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:21:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:24 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e 1073741824 Nov 06 21:21:24 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:25 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e 1073741824" returned: 0 in 0.590s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:25 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e Nov 06 21:21:25 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:25 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" returned: 0 in 0.427s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9506d4e-31bd-47b0-9a14-914fe5ae7dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a95fe35-c33c-4a98-b332-40b926ac517f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Volume volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e (1abcb110-9e8f-4d56-bed4-cd8f0cb3757e): created successfully Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a95fe35-c33c-4a98-b332-40b926ac517f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (4d4ad182-736d-4180-8bbb-01187295fcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ee6d3e6c-b416-4de5-ae20-14299e6d640e tempest-GroupSnapshotsTest-1575930250 None] Created volume successfully. Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (da6a5393-b122-4b8c-9586-0eb066575ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a557f127-7dbb-425a-98ba-ec31768a8ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a557f127-7dbb-425a-98ba-ec31768a8ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-884090930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316c5385-b2ff-45cb-bb74-1058b2870824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:27Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6093028c-27b7-446b-bead-5b1f0dbc4462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6093028c-27b7-446b-bead-5b1f0dbc4462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58acd7e-6626-4955-85aa-439b8468b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58acd7e-6626-4955-85aa-439b8468b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316c5385-b2ff-45cb-bb74-1058b2870824', 'volume_name': 'volume-316c5385-b2ff-45cb-bb74-1058b2870824', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479db536-4bbb-4a7c-981e-5e32e76065d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479db536-4bbb-4a7c-981e-5e32e76065d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a9e234-e884-42ae-9887-874e42d96759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:27 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Volume 316c5385-b2ff-45cb-bb74-1058b2870824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316c5385-b2ff-45cb-bb74-1058b2870824', 'volume_size': 1} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-884090930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316c5385-b2ff-45cb-bb74-1058b2870824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:27Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Creating volume 316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:27 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:27 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 1073741824 Nov 06 21:21:27 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] GroupSnapshot 20830f4f-c798-44b1-98b3-44f258384559: creating. Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Group snapshot 20830f4f-c798-44b1-98b3-44f258384559: creating. {{(pid=87450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:21:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:28 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 1073741824" returned: 0 in 0.715s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:28 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 Nov 06 21:21:28 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:28 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824" returned: 0 in 0.293s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.816s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Creating offline snapshot fca23d1c-62e3-4e62-9277-e43f90e11fcb of volume 1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a9e234-e884-42ae-9887-874e42d96759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316c5385-b2ff-45cb-bb74-1058b2870824', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfd7d56-e33a-4e20-b5c1-ba19a6ced867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be7c40a-1cca-4a8d-be8d-f005db945631]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Volume volume-316c5385-b2ff-45cb-bb74-1058b2870824 (316c5385-b2ff-45cb-bb74-1058b2870824): created successfully Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfd7d56-e33a-4e20-b5c1-ba19a6ced867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (da6a5393-b122-4b8c-9586-0eb066575ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4d980ee9-7489-4c48-9cd1-5275aa4a2921 tempest-VolumesSnapshotTestJSON-267030942 None] Created volume successfully. Nov 06 21:21:28 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e Nov 06 21:21:28 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:29 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" returned: 0 in 0.521s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:29 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb 1G Nov 06 21:21:29 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:29 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb 1G" returned: 0 in 0.554s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:29 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb Nov 06 21:21:29 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-83fe20d5-3369-4e70-8414-b19cd8cf704b tempest-GroupsV314Test-358274908 None] Group tempest-GroupsV314Test-Group-625978316: creating Nov 06 21:21:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-83fe20d5-3369-4e70-8414-b19cd8cf704b tempest-GroupsV314Test-358274908 None] Group tempest-GroupsV314Test-Group-625978316: created successfully Nov 06 21:21:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-83fe20d5-3369-4e70-8414-b19cd8cf704b tempest-GroupsV314Test-358274908 None] Create group completed successfully. Nov 06 21:21:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:30 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb" returned: 0 in 0.476s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:30 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:30 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb Nov 06 21:21:30 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:30 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb" returned: 0 in 0.274s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:30 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.info Nov 06 21:21:30 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:30 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.info" returned: 0 in 0.299s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:30 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:30 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.info Nov 06 21:21:30 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:31 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.info" returned: 0 in 0.300s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.056s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Creating offline snapshot 57e36b7f-1a23-47a9-858b-746ffa7ad558 of volume 316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1c965-ef15-486e-b368-b1dfa9a9028d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e24261e2-218d-4015-9dcf-733ea43a30a1 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 20830f4f-c798-44b1-98b3-44f258384559: created successfully Nov 06 21:21:31 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 Nov 06 21:21:31 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Flow 'volume_create_manager' (f9b80858-34cf-4e67-b56e-198420b3c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cc1c9c-ff92-45ac-af86-bfc86f578901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:31 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824" returned: 0 in 0.588s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cc1c9c-ff92-45ac-af86-bfc86f578901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404222177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1191d9aa-772d-4c4e-b58a-2d7a2e455f64,host='devstack@QuobyteHD#QuobyteHD',id=84bb0815-d235-49ea-b7d2-81533b6e9f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb5e983c47448b6a0cc12b24818f441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:32Z,use_quota=True,user_id='2b3b35f9faf942d4927ec828ebb340f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d23aad8-faa1-4128-a7da-0951dea1d260),volume_type_id=0d23aad8-faa1-4128-a7da-0951dea1d260)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:31 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 1G Nov 06 21:21:31 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949f4d89-0d47-49c2-b807-88c8596a2736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949f4d89-0d47-49c2-b807-88c8596a2736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b1acbd-901c-4a71-9e32-53131757c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b1acbd-901c-4a71-9e32-53131757c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bb0815-d235-49ea-b7d2-81533b6e9f01', 'volume_name': 'volume-84bb0815-d235-49ea-b7d2-81533b6e9f01', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d1a74c-3be2-4e48-a365-a1cfbe26cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d1a74c-3be2-4e48-a365-a1cfbe26cef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb76459-ac23-4d44-8e49-61218e5bcd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:31 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Volume 84bb0815-d235-49ea-b7d2-81533b6e9f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bb0815-d235-49ea-b7d2-81533b6e9f01', 'volume_size': 1} Nov 06 21:21:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:32 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 1G" returned: 0 in 0.538s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316c5385-b2ff-45cb-bb74-1058b2870824 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:32 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316c5385-b2ff-45cb-bb74-1058b2870824 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 Nov 06 21:21:32 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:32 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316c5385-b2ff-45cb-bb74-1058b2870824 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558" returned: 0 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:32 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 is being set with open permissions: ugo+rw Nov 06 21:21:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:32 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 Nov 06 21:21:32 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:33 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.info Nov 06 21:21:33 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.info" returned: 0 in 0.269s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.info is being set with open permissions: ugo+rw Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:33 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.info Nov 06 21:21:33 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.info" returned: 0 in 0.260s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1191d9aa-772d-4c4e-b58a-2d7a2e455f64,created_at=2026-11-06T20:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404222177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1191d9aa-772d-4c4e-b58a-2d7a2e455f64,host='devstack@QuobyteHD#QuobyteHD',id=84bb0815-d235-49ea-b7d2-81533b6e9f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb5e983c47448b6a0cc12b24818f441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:32Z,use_quota=True,user_id='2b3b35f9faf942d4927ec828ebb340f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d23aad8-faa1-4128-a7da-0951dea1d260),volume_type_id=0d23aad8-faa1-4128-a7da-0951dea1d260)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Creating volume 84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:33 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:21:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:33 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 1073741824 Nov 06 21:21:33 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b95cf26a-177a-497b-a9e1-c878e1b20dde tempest-VolumesSnapshotTestJSON-267030942 None] Create snapshot completed successfully Nov 06 21:21:34 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 1073741824" returned: 0 in 0.471s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:34 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 Nov 06 21:21:34 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-57e36b7f-1a23-47a9-858b-746ffa7ad558-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-57e36b7f-1a23-47a9-858b-746ffa7ad558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-316c5385-b2ff-45cb-bb74-1058b2870824" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:34 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-316c5385-b2ff-45cb-bb74-1058b2870824" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-57e36b7f-1a23-47a9-858b-746ffa7ad558" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01" returned: 0 in 0.407s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.525s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-fca23d1c-62e3-4e62-9277-e43f90e11fcb-5f8026b1-2420-49b0-a055-c72daf6fa577" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-57e36b7f-1a23-47a9-858b-746ffa7ad558" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Deleting offline snapshot 57e36b7f-1a23-47a9-858b-746ffa7ad558 of volume 316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] snapshot_file for this snap is: volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb76459-ac23-4d44-8e49-61218e5bcd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bb0815-d235-49ea-b7d2-81533b6e9f01', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c1bcee-a300-4795-91a6-3a393bbe9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-fca23d1c-62e3-4e62-9277-e43f90e11fcb-5f8026b1-2420-49b0-a055-c72daf6fa577" acquired by "_create_volume_from_snapshot" :: waited 0.079s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Creating volume 5f8026b1-2420-49b0-a055-c72daf6fa577 from snapshot fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-5f8026b1-2420-49b0-a055-c72daf6fa577" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f827777-afbe-41a5-8a71-92bb926192c5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Volume volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 (84bb0815-d235-49ea-b7d2-81533b6e9f01): created successfully Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c1bcee-a300-4795-91a6-3a393bbe9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Flow 'volume_create_manager' (f9b80858-34cf-4e67-b56e-198420b3c45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-5f8026b1-2420-49b0-a055-c72daf6fa577" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] snapshot: fca23d1c-62e3-4e62-9277-e43f90e11fcb, volume: 5f8026b1-2420-49b0-a055-c72daf6fa577, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ce78ddf2-d393-4c76-94c9-d128b5c9d5a0 tempest-GroupsV314Test-358274908 None] Created volume successfully. Nov 06 21:21:34 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 Nov 06 21:21:34 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff95531-7294-419e-9558-f8483e29e700]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:35 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb Nov 06 21:21:35 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:35 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558" returned: 0 in 0.441s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-316c5385-b2ff-45cb-bb74-1058b2870824(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3cb7a9-12ac-4873-b6fe-ad29bc8dd15f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:35 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 Nov 06 21:21:35 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:35 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb" returned: 0 in 0.506s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd421154-db97-40bd-a3dd-8452d836f58c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:35 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e Nov 06 21:21:35 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:35 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824" returned: 0 in 0.484s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:35 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 Nov 06 21:21:35 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:36 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" returned: 0 in 0.539s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:36 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 Nov 06 21:21:36 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:36 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558" returned: 0 in 0.477s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:36 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558 Nov 06 21:21:36 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:36 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824.57e36b7f-1a23-47a9-858b-746ffa7ad558" returned: 0 in 0.325s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-57e36b7f-1a23-47a9-858b-746ffa7ad558" released by "_delete_snapshot" :: held 1.961s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-316c5385-b2ff-45cb-bb74-1058b2870824" released by "delete_snapshot" :: held 2.004s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['ccf71daa-2ff3-43a3-82fb-4337a89b8b97', 'fd2c5287-6379-4aff-ba53-37b83128e45d', '46ea3b79-0587-4c1b-b63e-f6a43ad3910f', '4a5dce5a-2b15-4ac4-8b97-1d93af1cc8e8'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Delete snapshot completed successfully. Nov 06 21:21:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a422dbe-9a7c-4102-a3e6-07983054c1ca tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-57e36b7f-1a23-47a9-858b-746ffa7ad558-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (04335dd3-8ed8-48c9-9180-2608a7e71fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e46a19-430d-400f-892b-c9bd3a0bc42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e46a19-430d-400f-892b-c9bd3a0bc42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1985651295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6719474b-2e96-48c6-8575-0d623d4aeb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:39Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8841fd8-b60e-4ab7-96e2-bd8990b2807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8841fd8-b60e-4ab7-96e2-bd8990b2807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc92f1a3-6c79-4cfa-b30d-129d79e659fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc92f1a3-6c79-4cfa-b30d-129d79e659fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6719474b-2e96-48c6-8575-0d623d4aeb97', 'volume_name': 'volume-6719474b-2e96-48c6-8575-0d623d4aeb97', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494ec768-ad1a-4a37-87e9-9f4ce93cdd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494ec768-ad1a-4a37-87e9-9f4ce93cdd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab3674c-dcb2-4128-acf1-1970f7ea61a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Volume 6719474b-2e96-48c6-8575-0d623d4aeb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6719474b-2e96-48c6-8575-0d623d4aeb97', 'volume_size': 1} Nov 06 21:21:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:44 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577" returned: 0 in 8.491s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:44 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:21:44 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Converted 1024.00 MB image at 120.59 MB/s Nov 06 21:21:44 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:44 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 Nov 06 21:21:44 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:44 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577" returned: 0 in 0.374s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-5f8026b1-2420-49b0-a055-c72daf6fa577" released by "_copy_volume_from_snapshot" :: held 10.073s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-fca23d1c-62e3-4e62-9277-e43f90e11fcb-5f8026b1-2420-49b0-a055-c72daf6fa577" released by "_create_volume_from_snapshot" :: held 10.241s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.322s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.939s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:45 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Cloning volume 84bb0815-d235-49ea-b7d2-81533b6e9f01 to volume fb39cdad-f01c-4eef-8955-20be2ef82ea7 Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Creating offline snapshot 5517fb0a-6daf-4f62-be4e-a1e28ff3faeb of volume 84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e310e0-d4ca-4608-a365-6da5cb8daece]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a1869868-6f24-4368-9c72-d3b33c489d62 tempest-GroupSnapshotsTest-1575930250 None] Create group from source-snapshot-20830f4f-c798-44b1-98b3-44f258384559 completed successfully. Nov 06 21:21:45 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 Nov 06 21:21:45 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:45 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01" returned: 0 in 0.693s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb 1G Nov 06 21:21:45 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb 1G" returned: 0 in 0.602s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:46 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb Nov 06 21:21:46 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" returned: 0 in 0.409s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:46 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-5f8026b1-2420-49b0-a055-c72daf6fa577" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:46 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb Nov 06 21:21:46 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-5f8026b1-2420-49b0-a055-c72daf6fa577" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[95170d68-73ee-4019-8270-d0b8c5c3be56]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 Nov 06 21:21:47 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:47 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" returned: 0 in 0.375s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.info Nov 06 21:21:47 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:47 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577" returned: 0 in 0.545s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577 Nov 06 21:21:47 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:47 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.info" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.info Nov 06 21:21:47 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:47 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5f8026b1-2420-49b0-a055-c72daf6fa577" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-5f8026b1-2420-49b0-a055-c72daf6fa577" released by "delete_volume" :: held 0.988s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:47 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.info" returned: 0 in 0.324s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Acquiring lock "cinder-quobyte-fb39cdad-f01c-4eef-8955-20be2ef82ea7" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-fb39cdad-f01c-4eef-8955-20be2ef82ea7" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] snapshot: 5517fb0a-6daf-4f62-be4e-a1e28ff3faeb, volume: fb39cdad-f01c-4eef-8955-20be2ef82ea7, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91767f-8999-422c-935d-8ca7ec365e81]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['001b5dfe-c775-4bc5-acbc-bbf0659bc7d0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:48 devstack cinder-volume[87450]: WARNING cinder.quota [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-771539582 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-771539582, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:48 devstack cinder-volume[87450]: WARNING cinder.quota [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-771539582 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-771539582, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['6a725225-7f43-47aa-bda4-e45e2495d5de', '7dcc66d6-a571-48e2-89f8-5d7e61399a2f', '8a998523-f594-4788-ae8d-138c83c4e5db', '151e305a-09d3-49bb-a32b-c96ef3c2f39d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:48 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb Nov 06 21:21:48 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:48 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:21:48 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:48 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" returned: 0 in 0.673s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84bb0815-d235-49ea-b7d2-81533b6e9f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81b01e3-0cd8-40d9-8695-2cfc40d21c54]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:48 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.402s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:48 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9d958dd2-fd9c-4bdf-8d14-646d7a6eba02 tempest-GroupSnapshotsTest-1575930250 None] Delete group completed successfully. Nov 06 21:21:48 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 Nov 06 21:21:48 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:49 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:49 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 Nov 06 21:21:49 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:49 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 20830f4f-c798-44b1-98b3-44f258384559: deleting Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 20830f4f-c798-44b1-98b3-44f258384559: deleting {{(pid=87450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-fca23d1c-62e3-4e62-9277-e43f90e11fcb" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-fca23d1c-62e3-4e62-9277-e43f90e11fcb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Deleting offline snapshot fca23d1c-62e3-4e62-9277-e43f90e11fcb of volume 1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] snapshot_file for this snap is: volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f677c3e-34d1-4222-bb29-65e871d676e3]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:49 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb Nov 06 21:21:49 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:50 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb" returned: 0 in 0.867s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[86690a63-e8d8-4a65-9e32-140b82444986]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:50 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e Nov 06 21:21:50 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:51 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" returned: 0 in 0.890s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:51 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb Nov 06 21:21:51 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:52 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb" returned: 0 in 0.911s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:52 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb Nov 06 21:21:52 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:53 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e.fca23d1c-62e3-4e62-9277-e43f90e11fcb" returned: 0 in 0.523s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-fca23d1c-62e3-4e62-9277-e43f90e11fcb" released by "_delete_snapshot" :: held 3.432s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" released by "delete_snapshot" :: held 3.477s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:53 devstack cinder-volume[87450]: WARNING cinder.quota [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-771539582 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-771539582, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:53 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['5c7af68e-aa9c-4d27-8335-6e25606adeb3', '4d5d6d1e-5f4e-49b1-abb5-041763cad6af', '90078d28-55b6-4ade-921a-d1c0dbd413b4', 'bfe75a39-0e41-4dd7-ad9e-868b35a58b53'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-afa300b9-e3b2-4940-b87a-c37ae44b899d tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 20830f4f-c798-44b1-98b3-44f258384559: deleted successfully Nov 06 21:21:54 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:54 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" acquired by "delete_volume" :: waited 0.054s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:55 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7343fd-76a9-4566-9d0c-1d4116e4663d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:55 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e Nov 06 21:21:55 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:55 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" returned: 0 in 0.745s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:55 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e Nov 06 21:21:55 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:56 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" returned: 0 in 0.675s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-1abcb110-9e8f-4d56-bed4-cd8f0cb3757e" released by "delete_volume" :: held 1.572s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:56 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['5ba430ae-2048-4e3b-b1b4-7de4e3caba02'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:56 devstack cinder-volume[87450]: WARNING cinder.db.api [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-771539582'] Nov 06 21:21:56 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['cbc34245-b97e-4c58-bb91-5f058ab78836', '9323b503-8490-4bde-9d69-52aa44918f62', '63079080-f7f5-4f23-8599-d45376e28889', 'cf579225-6654-4c59-bc16-144852eabacd'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:57 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:21:57 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:57 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.649s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:57 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-49266b1b-e452-4176-a506-2fe10ad1908a tempest-GroupSnapshotsTest-1575930250 None] Delete group completed successfully. Nov 06 21:21:57 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7" returned: 0 in 8.582s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:21:57 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Converted 1024.00 MB image at 119.31 MB/s Nov 06 21:21:57 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:57 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 Nov 06 21:21:57 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:58 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7" returned: 0 in 0.278s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-fb39cdad-f01c-4eef-8955-20be2ef82ea7" released by "_copy_volume_from_snapshot" :: held 10.187s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Acquiring lock "cinder-quobyte-5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Deleting offline snapshot 5517fb0a-6daf-4f62-be4e-a1e28ff3faeb of volume 84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] snapshot_file for this snap is: volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[971691e6-5e19-4584-b22f-9495fb398d07]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7682f0f5-0427-45a6-a978-7975c79f1038 tempest-GroupSnapshotsTest-1575930250 None] Group tempest-GroupSnapshotsTest-Group-1154438875: creating Nov 06 21:21:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7682f0f5-0427-45a6-a978-7975c79f1038 tempest-GroupSnapshotsTest-1575930250 None] Group tempest-GroupSnapshotsTest-Group-1154438875: created successfully Nov 06 21:21:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7682f0f5-0427-45a6-a978-7975c79f1038 tempest-GroupSnapshotsTest-1575930250 None] Create group completed successfully. Nov 06 21:21:58 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb Nov 06 21:21:58 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:58 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" returned: 0 in 0.432s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84bb0815-d235-49ea-b7d2-81533b6e9f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d698754-e1a8-459c-854d-e403b43b4cac]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:58 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 Nov 06 21:21:58 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:59 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01" returned: 0 in 0.567s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:59 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb Nov 06 21:21:59 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:59 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" returned: 0 in 0.488s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:59 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb Nov 06 21:21:59 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (02da8266-b0fe-4314-acc2-460ccfeda357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2aa3a24-92cc-4b12-879e-8edf0780d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2aa3a24-92cc-4b12-879e-8edf0780d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-545681398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=614066c8-2cff-4975-aef6-7e9eca5c3a51,host='devstack@QuobyteHD#QuobyteHD',id=e7d0acc0-849a-4615-b7ba-4df892b48fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:00Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(456ae0a8-0204-4432-a59c-6205fcfd7c26),volume_type_id=456ae0a8-0204-4432-a59c-6205fcfd7c26)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e479385-6cd7-47d8-8e62-630fddb4d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e479385-6cd7-47d8-8e62-630fddb4d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:00 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c55729-221f-4d64-bf7e-59746843d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c55729-221f-4d64-bf7e-59746843d903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d0acc0-849a-4615-b7ba-4df892b48fc4', 'volume_name': 'volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe947be4-b250-4032-96d2-117e5a371904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe947be4-b250-4032-96d2-117e5a371904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb70c858-20a0-46e4-b65a-51e9d7158a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Volume e7d0acc0-849a-4615-b7ba-4df892b48fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4', 'volume_size': 1} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01.5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" returned: 0 in 0.345s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-5517fb0a-6daf-4f62-be4e-a1e28ff3faeb" released by "_delete_snapshot" :: held 1.940s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.180s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.673s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1985651295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6719474b-2e96-48c6-8575-0d623d4aeb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:39Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Creating volume 6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:00 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:00 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 1073741824 Nov 06 21:22:00 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0bb27887-6e9a-4fad-859f-d30340da764d tempest-GroupsV314Test-358274908 None] Create group from source-group-1191d9aa-772d-4c4e-b58a-2d7a2e455f64 completed successfully. Nov 06 21:22:00 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 1073741824" returned: 0 in 0.492s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:00 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 Nov 06 21:22:00 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:01 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=614066c8-2cff-4975-aef6-7e9eca5c3a51,created_at=2026-11-06T20:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-545681398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=614066c8-2cff-4975-aef6-7e9eca5c3a51,host='devstack@QuobyteHD#QuobyteHD',id=e7d0acc0-849a-4615-b7ba-4df892b48fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:00Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(456ae0a8-0204-4432-a59c-6205fcfd7c26),volume_type_id=456ae0a8-0204-4432-a59c-6205fcfd7c26)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Creating volume e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:01 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab3674c-dcb2-4128-acf1-1970f7ea61a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6719474b-2e96-48c6-8575-0d623d4aeb97', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:01 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 1073741824 Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b6226f-9359-46df-b405-088a4921a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:01 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:01 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Volume volume-6719474b-2e96-48c6-8575-0d623d4aeb97 (6719474b-2e96-48c6-8575-0d623d4aeb97): created successfully Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b6226f-9359-46df-b405-088a4921a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (04335dd3-8ed8-48c9-9180-2608a7e71fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:01 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8f34b569-ead1-48ff-bf32-00bf04e49da0 tempest-VolumesSnapshotTestJSON-267030942 None] Created volume successfully. Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Acquiring lock "cinder-quobyte-fb39cdad-f01c-4eef-8955-20be2ef82ea7" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-fb39cdad-f01c-4eef-8955-20be2ef82ea7" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce303cb5-3ec1-48e6-82f8-f8277eadfb2d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:01 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 Nov 06 21:22:01 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:01 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 1073741824" returned: 0 in 0.593s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:01 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 Nov 06 21:22:01 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:01 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7" returned: 0 in 0.498s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:01 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7 Nov 06 21:22:02 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:02 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4" returned: 0 in 0.322s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.160s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb70c858-20a0-46e4-b65a-51e9d7158a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a16026-2170-407b-b856-46da263764cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Creating offline snapshot a318b97c-4770-40f8-bdb7-c81bfe7b358f of volume 6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:02 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Volume volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 (e7d0acc0-849a-4615-b7ba-4df892b48fc4): created successfully Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a16026-2170-407b-b856-46da263764cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (02da8266-b0fe-4314-acc2-460ccfeda357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10e4a4-c9c7-4df9-8025-8d82aa1f9bc7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-49ad9426-7faf-49ee-84c4-9b13304661d3 tempest-GroupSnapshotsTest-1575930250 None] Created volume successfully. Nov 06 21:22:02 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb39cdad-f01c-4eef-8955-20be2ef82ea7" returned: 0 in 0.299s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-fb39cdad-f01c-4eef-8955-20be2ef82ea7" released by "delete_volume" :: held 0.847s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:02 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 Nov 06 21:22:02 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Created reservations ['70a3d580-8bf6-492c-9ce3-662a1a8b9c1f'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:02 devstack cinder-volume[87450]: WARNING cinder.quota [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-995320875 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-995320875, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:02 devstack cinder-volume[87450]: WARNING cinder.quota [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-995320875 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-995320875, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Created reservations ['6a7c3b03-7a8b-4d82-9d23-2497a8afaef3', '97d6d745-a173-4b7a-89a0-d936f65fb448', 'df004620-e942-4c3e-96a3-5082344aea31', '5d5c9b50-1b98-4484-85da-cd7880af5f24'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:02 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:02 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:02 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97" returned: 0 in 0.523s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:02 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f 1G Nov 06 21:22:02 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:02 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.383s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:02 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c81125bd-3429-454f-9e49-f5386d7647c7 tempest-GroupsV314Test-358274908 None] Delete group completed successfully. Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Acquiring lock "cinder-quobyte-84bb0815-d235-49ea-b7d2-81533b6e9f01" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-84bb0815-d235-49ea-b7d2-81533b6e9f01" acquired by "delete_volume" :: waited 0.045s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8162714-6c78-46ea-b5af-5faeb484ae1e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (67e1fd79-8ada-468e-ad9f-3c18e059ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f6ed2d-27a7-4b9e-9c71-37e53870888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:03 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f 1G" returned: 0 in 0.659s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6719474b-2e96-48c6-8575-0d623d4aeb97 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:03 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f6ed2d-27a7-4b9e-9c71-37e53870888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-846244117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=614066c8-2cff-4975-aef6-7e9eca5c3a51,host='devstack@QuobyteHD#QuobyteHD',id=7ff83933-f059-4ecd-a827-3f83e54002dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:03Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(456ae0a8-0204-4432-a59c-6205fcfd7c26),volume_type_id=456ae0a8-0204-4432-a59c-6205fcfd7c26)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:03 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:03 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6719474b-2e96-48c6-8575-0d623d4aeb97 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f Nov 06 21:22:03 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b418bd-d0c9-4d90-bbac-f12154966ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b418bd-d0c9-4d90-bbac-f12154966ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3264288c-b6dc-4c26-b318-cba21f3d3976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3264288c-b6dc-4c26-b318-cba21f3d3976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff83933-f059-4ecd-a827-3f83e54002dd', 'volume_name': 'volume-7ff83933-f059-4ecd-a827-3f83e54002dd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5520a7b-35f8-4cbc-a70d-89455b99806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5520a7b-35f8-4cbc-a70d-89455b99806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b582ecc0-2ad2-4681-b6a5-79a775f385f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:03 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Volume 7ff83933-f059-4ecd-a827-3f83e54002dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff83933-f059-4ecd-a827-3f83e54002dd', 'volume_size': 1} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:03 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01" returned: 0 in 0.416s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:03 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6719474b-2e96-48c6-8575-0d623d4aeb97 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f" returned: 0 in 0.304s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:03 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f is being set with open permissions: ugo+rw Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:03 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01 Nov 06 21:22:03 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:03 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f Nov 06 21:22:03 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:03 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-84bb0815-d235-49ea-b7d2-81533b6e9f01" returned: 0 in 0.254s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Lock "cinder-quobyte-84bb0815-d235-49ea-b7d2-81533b6e9f01" released by "delete_volume" :: held 0.776s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:03 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f" returned: 0 in 0.269s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:04 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.info Nov 06 21:22:04 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Created reservations ['e383c69d-3bde-41be-a4e5-23be534ee5cb'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Created reservations ['b7dcaf4b-a1ea-49ab-83f8-b0e4f1023d36', '2e651c60-7534-4e71-aa38-e009757b20e2', 'f9b9ee9d-aff6-4e6b-8d95-e816c74351bb', '4e2bf91c-98e9-4087-80b6-9d92fed6ed6e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:04 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:04 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:04 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.info" returned: 0 in 0.311s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:04 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.info is being set with open permissions: ugo+rw Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:04 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.info Nov 06 21:22:04 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:04 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.270s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bae47d52-7f14-497c-b5f9-6544cd8c6c9c tempest-GroupsV314Test-358274908 None] Delete group completed successfully. Nov 06 21:22:04 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.info" returned: 0 in 0.277s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=614066c8-2cff-4975-aef6-7e9eca5c3a51,created_at=2026-11-06T20:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-846244117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=614066c8-2cff-4975-aef6-7e9eca5c3a51,host='devstack@QuobyteHD#QuobyteHD',id=7ff83933-f059-4ecd-a827-3f83e54002dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:03Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(456ae0a8-0204-4432-a59c-6205fcfd7c26),volume_type_id=456ae0a8-0204-4432-a59c-6205fcfd7c26)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Creating volume 7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:04 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:22:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:04 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd 1073741824 Nov 06 21:22:04 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9b4046de-3172-4363-9b36-c1103e7c1a0f tempest-VolumesSnapshotTestJSON-267030942 None] Create snapshot completed successfully Nov 06 21:22:05 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd 1073741824" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:05 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd Nov 06 21:22:05 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:05 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b582ecc0-2ad2-4681-b6a5-79a775f385f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff83933-f059-4ecd-a827-3f83e54002dd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199c8d19-09cd-46d8-949d-4ad08bf6633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Volume volume-7ff83933-f059-4ecd-a827-3f83e54002dd (7ff83933-f059-4ecd-a827-3f83e54002dd): created successfully Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199c8d19-09cd-46d8-949d-4ad08bf6633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (67e1fd79-8ada-468e-ad9f-3c18e059ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-57552b89-17ff-4454-919d-42fcc341f3e9 tempest-GroupSnapshotsTest-1575930250 None] Created volume successfully. Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (b358c4cf-92cd-4a36-b74c-4c0f1b8d8e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6cb08f-c97e-4e33-8e8e-3793610f8ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6cb08f-c97e-4e33-8e8e-3793610f8ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-300311797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a318b97c-4770-40f8-bdb7-c81bfe7b358f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:06Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a9f423-27e8-4639-a305-daa9bf95fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a9f423-27e8-4639-a305-daa9bf95fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff0a257-324f-4e3f-8e26-d003cadf1dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff0a257-324f-4e3f-8e26-d003cadf1dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db', 'volume_name': 'volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db', 'volume_size': 2, 'snapshot_id': 'a318b97c-4770-40f8-bdb7-c81bfe7b358f'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f628a059-fc0a-437b-b0c0-a484adc6ab8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f628a059-fc0a-437b-b0c0-a484adc6ab8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120e0f8d-d421-4b4b-a416-718e5982a475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Volume 2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db', 'volume_size': 2, 'snapshot_id': 'a318b97c-4770-40f8-bdb7-c81bfe7b358f'} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-a318b97c-4770-40f8-bdb7-c81bfe7b358f-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-a318b97c-4770-40f8-bdb7-c81bfe7b358f-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Creating volume 2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db from snapshot a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] snapshot: a318b97c-4770-40f8-bdb7-c81bfe7b358f, volume: 2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:06 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d3654dd5-1fa4-4817-9efd-8bf10389efb8 tempest-GroupSnapshotsTest-1575930250 None] Update group completed successfully. Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e434f461-21a3-433f-8e1d-0ac194a80a73]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:06 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f Nov 06 21:22:06 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:06 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f" returned: 0 in 0.438s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6719474b-2e96-48c6-8575-0d623d4aeb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f360a1-d370-4ce3-ad01-7269dad0a7eb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:06 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 Nov 06 21:22:06 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:06 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97" returned: 0 in 0.463s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:22:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:07 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db Nov 06 21:22:07 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-073c2174-70f4-410e-8fa5-45a687179f66 tempest-GroupSnapshotsTest-1575930250 None] Update group completed successfully. Nov 06 21:22:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0b60237a-1bbc-4bc1-ac2e-5ce22676de42 tempest-GroupSnapshotsTest-1575930250 None] Update group completed successfully. Nov 06 21:22:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-73797f4a-8f13-413b-b68b-483e03d9ade7 tempest-GroupSnapshotsTest-1575930250 None] Update group completed successfully. Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:11 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:11 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:11 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.543s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:22:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:22:12 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Flow 'volume_create_manager' (5d48eb6b-4bdb-48f7-80ef-33a38186d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09345cdb-3650-47d6-ae63-81ea1a157532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:12 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] GroupSnapshot 43806393-4b75-4110-8c2a-5093fc7e198d: creating. Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09345cdb-3650-47d6-ae63-81ea1a157532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-362717118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161140dc-b99b-4310-985f-c875d167e614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a60a71226149148d2fc69cdfb86ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:13Z,use_quota=True,user_id='dd873dc831d74d688159c36719cf0118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52e6f51-5aa8-4cb3-ae43-14d0a60a80ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52e6f51-5aa8-4cb3-ae43-14d0a60a80ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdddc8f-1db6-4555-9a0c-e60d0626e480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdddc8f-1db6-4555-9a0c-e60d0626e480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161140dc-b99b-4310-985f-c875d167e614', 'volume_name': 'volume-161140dc-b99b-4310-985f-c875d167e614', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06de281a-5b24-4c6b-bae2-cea78b54e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06de281a-5b24-4c6b-bae2-cea78b54e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfcc7af-595d-4ae0-b659-f2e45eea32aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:13 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Volume 161140dc-b99b-4310-985f-c875d167e614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161140dc-b99b-4310-985f-c875d167e614', 'volume_size': 1} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Group snapshot 43806393-4b75-4110-8c2a-5093fc7e198d: creating. {{(pid=87450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:22:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=114,cinder:UPDATE=101,cinder:DELETE=4,cinder:INSERT=24 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=105,cinder:SELECT=113,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Flow 'volume_create_manager' (ddeaff69-4e56-409a-a158-c43df099394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2482565d-6517-4284-b177-b5c224bff59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2482565d-6517-4284-b177-b5c224bff59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1580403771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea9eadd-dc1b-4ebb-937d-60ea727d78f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff5cddc5af1419f86c8790c1d825434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:15Z,use_quota=True,user_id='6f6695cae54348bb9a424fef336e8851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034afd55-18f6-4d7d-ba71-d71ca8b4d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034afd55-18f6-4d7d-ba71-d71ca8b4d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55625f1-5818-4b65-8dee-b3872b7a52b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55625f1-5818-4b65-8dee-b3872b7a52b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea9eadd-dc1b-4ebb-937d-60ea727d78f3', 'volume_name': 'volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fc8f42-ec8a-4697-99b4-ece5d6d0b6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fc8f42-ec8a-4697-99b4-ece5d6d0b6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a09ed7-0c94-4897-a5c6-de892f976afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:15 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3', 'volume_size': 1} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:15 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" returned: 0 in 8.844s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:15 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Converted 1024.00 MB image at 115.78 MB/s Nov 06 21:22:15 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db is being set with open permissions: ugo+rw Nov 06 21:22:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:15 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db Nov 06 21:22:15 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:16 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" returned: 0 in 0.243s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" released by "_copy_volume_from_snapshot" :: held 10.101s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-a318b97c-4770-40f8-bdb7-c81bfe7b358f-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" released by "_create_volume_from_snapshot" :: held 10.171s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.192s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.878s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-362717118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161140dc-b99b-4310-985f-c875d167e614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a60a71226149148d2fc69cdfb86ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:13Z,use_quota=True,user_id='dd873dc831d74d688159c36719cf0118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Creating volume 161140dc-b99b-4310-985f-c875d167e614 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:16 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:16 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 1073741824 Nov 06 21:22:16 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120e0f8d-d421-4b4b-a416-718e5982a475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db', 'volume_size': 2, 'snapshot_id': 'a318b97c-4770-40f8-bdb7-c81bfe7b358f'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ab94b9-1bc7-40c6-a3fc-6362bde1c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Volume volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db (2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db): created successfully Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ab94b9-1bc7-40c6-a3fc-6362bde1c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (b358c4cf-92cd-4a36-b74c-4c0f1b8d8e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b42b3bdc-2379-4eb0-be20-8493bca259fc tempest-VolumesSnapshotTestJSON-267030942 None] Created volume successfully. Nov 06 21:22:16 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 1073741824" returned: 0 in 0.437s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:16 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 Nov 06 21:22:16 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:16 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614" returned: 0 in 0.232s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.566s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfcc7af-595d-4ae0-b659-f2e45eea32aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161140dc-b99b-4310-985f-c875d167e614', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae0b040-b019-4ce7-a498-1570da412e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Creating offline snapshot 281feb3c-632c-4ed3-b4c9-34083b12dd13 of volume 7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Volume volume-161140dc-b99b-4310-985f-c875d167e614 (161140dc-b99b-4310-985f-c875d167e614): created successfully Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae0b040-b019-4ce7-a498-1570da412e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Flow 'volume_create_manager' (5d48eb6b-4bdb-48f7-80ef-33a38186d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[87458baf-74a9-4634-b5d7-5096c329166a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1503e7e5-1b80-4e26-b02b-95cfadc1fe2c tempest-AttachVolumeNegativeTest-603549752 None] Created volume successfully. Nov 06 21:22:17 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd Nov 06 21:22:17 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:17 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd" returned: 0 in 0.413s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:17 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 1G Nov 06 21:22:17 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87eb4c9-8cc3-4fe1-a842-38fbffe40484]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:17 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db Nov 06 21:22:17 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:17 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 1G" returned: 0 in 0.489s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff83933-f059-4ecd-a827-3f83e54002dd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:17 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" returned: 0 in 0.455s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:17 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff83933-f059-4ecd-a827-3f83e54002dd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 Nov 06 21:22:17 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:17 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db Nov 06 21:22:17 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-1e99269a-759f-4613-9fab-2fe9ed2aa918 req-344e282f-eb9b-4a2e-adcc-2beb2755c443 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:18 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" returned: 0 in 0.276s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:18 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db" released by "delete_volume" :: held 0.786s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff83933-f059-4ecd-a827-3f83e54002dd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13" returned: 0 in 0.315s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:18 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:18 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 Nov 06 21:22:18 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['68f7b29e-a6c9-4993-ac31-1de556e78b0a', 'b3ac6a99-92ff-4638-8d71-2edbe3d45b97', '55eea080-736c-432b-a572-d2d269e3a93f', '7caad53f-27b0-49e2-a32f-7bc0726ae856'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:18 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:18 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:18 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13" returned: 0 in 0.278s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-a318b97c-4770-40f8-bdb7-c81bfe7b358f-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:18 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.info Nov 06 21:22:18 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-a318b97c-4770-40f8-bdb7-c81bfe7b358f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-6719474b-2e96-48c6-8575-0d623d4aeb97" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-6719474b-2e96-48c6-8575-0d623d4aeb97" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-a318b97c-4770-40f8-bdb7-c81bfe7b358f" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-a318b97c-4770-40f8-bdb7-c81bfe7b358f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Deleting offline snapshot a318b97c-4770-40f8-bdb7-c81bfe7b358f of volume 6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:18 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] snapshot_file for this snap is: volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.314s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Deleted volume successfully. Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94eac1e-bd1c-4bf9-8a8d-cbe7d74a3e4a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2bcb986a-b5a5-4e10-8bb1-2be87e6f530c tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-2a8ab5ec-9dbc-4ed4-8a0a-c9f8e848b1db-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:18 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f Nov 06 21:22:18 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:18 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.info" returned: 0 in 0.323s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:18 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:18 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.info Nov 06 21:22:18 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:18 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f" returned: 0 in 0.388s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6719474b-2e96-48c6-8575-0d623d4aeb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dd1f12-d0f4-4c6e-b04f-44db1510a3bd]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:19 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.info" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Creating offline snapshot 5878797d-d43b-4763-8966-2d7f13f6321c of volume e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f056b-9ca8-4e19-9d58-4a0d0cdfd65f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:19 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 Nov 06 21:22:19 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:19 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 Nov 06 21:22:19 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:19 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4" returned: 0 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:19 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c 1G Nov 06 21:22:19 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:19 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97" returned: 0 in 0.574s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:19 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f Nov 06 21:22:19 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:19 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:19 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c 1G" returned: 0 in 0.428s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:19 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f Nov 06 21:22:19 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:19 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c Nov 06 21:22:19 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:20 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97.a318b97c-4770-40f8-bdb7-c81bfe7b358f" returned: 0 in 0.253s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-a318b97c-4770-40f8-bdb7-c81bfe7b358f" released by "_delete_snapshot" :: held 1.684s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:20 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c" returned: 0 in 0.290s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:20 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-6719474b-2e96-48c6-8575-0d623d4aeb97" released by "delete_snapshot" :: held 1.720s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:20 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c Nov 06 21:22:20 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['79d2e7f5-9790-4ec9-b209-fec4147e0b2f', '16a0b2bd-752a-439a-bcce-dd2e4320b2cf', 'a430fede-3231-4ecf-b6b0-9a61afa9c153', '0b2e4c15-c301-47d7-80a9-f417326e593c'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Delete snapshot completed successfully. Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b80037b1-f233-464c-96dc-d4177305676e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-a318b97c-4770-40f8-bdb7-c81bfe7b358f-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:20 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c" returned: 0 in 0.254s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:20 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.info Nov 06 21:22:20 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-6719474b-2e96-48c6-8575-0d623d4aeb97-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-6719474b-2e96-48c6-8575-0d623d4aeb97-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:20 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-6719474b-2e96-48c6-8575-0d623d4aeb97" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.info" returned: 0 in 0.276s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:20 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-6719474b-2e96-48c6-8575-0d623d4aeb97" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:20 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.info Nov 06 21:22:20 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95f780f-8713-407f-848c-d7e31ffac4b2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:21 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 Nov 06 21:22:21 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:21 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.info" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-1e99269a-759f-4613-9fab-2fe9ed2aa918 req-344e282f-eb9b-4a2e-adcc-2beb2755c443 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.057s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-1e99269a-759f-4613-9fab-2fe9ed2aa918 req-344e282f-eb9b-4a2e-adcc-2beb2755c443 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.813s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1580403771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea9eadd-dc1b-4ebb-937d-60ea727d78f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff5cddc5af1419f86c8790c1d825434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:15Z,use_quota=True,user_id='6f6695cae54348bb9a424fef336e8851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Creating volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:21 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:21 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 1073741824 Nov 06 21:22:21 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-1e99269a-759f-4613-9fab-2fe9ed2aa918 req-344e282f-eb9b-4a2e-adcc-2beb2755c443 tempest-AttachVolumeNegativeTest-603549752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-161140dc-b99b-4310-985f-c875d167e614', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f51ea02-c9ba-4c6a-8a56-a09c78ceb61f', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:22:21 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97" returned: 0 in 0.442s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-1e99269a-759f-4613-9fab-2fe9ed2aa918 req-344e282f-eb9b-4a2e-adcc-2beb2755c443 tempest-AttachVolumeNegativeTest-603549752 None] attachment_update completed successfully. Nov 06 21:22:21 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97 Nov 06 21:22:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0939fbde-83bc-4ffd-b085-d5f3a817de68 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 43806393-4b75-4110-8c2a-5093fc7e198d: created successfully Nov 06 21:22:21 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 43806393-4b75-4110-8c2a-5093fc7e198d: deleting Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 43806393-4b75-4110-8c2a-5093fc7e198d: deleting {{(pid=87450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:22:21 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-7ff83933-f059-4ecd-a827-3f83e54002dd" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6719474b-2e96-48c6-8575-0d623d4aeb97" returned: 0 in 0.451s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-6719474b-2e96-48c6-8575-0d623d4aeb97" released by "delete_volume" :: held 0.977s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-7ff83933-f059-4ecd-a827-3f83e54002dd" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-281feb3c-632c-4ed3-b4c9-34083b12dd13" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:21 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 1073741824" returned: 0 in 0.693s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-281feb3c-632c-4ed3-b4c9-34083b12dd13" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Deleting offline snapshot 281feb3c-632c-4ed3-b4c9-34083b12dd13 of volume 7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] snapshot_file for this snap is: volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83a693-8487-4874-a63e-1ff8f3d3503a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:22 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 Nov 06 21:22:22 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['3c8d2097-e454-441d-87a0-f844394969d2', '446d3512-bf3d-44b6-804b-dea70b510b52', '0b29d9ff-b274-44af-af20-103d99ff12f7', 'a84f6ebd-ebeb-403a-b4e8-5f0d7856d4d5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:22 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 Nov 06 21:22:22 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:22 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:22 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:22 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13" returned: 0 in 0.613s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff83933-f059-4ecd-a827-3f83e54002dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:22 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3280184c-5cb8-4f04-aa2a-034b47aca9d5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" returned: 0 in 0.612s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a09ed7-0c94-4897-a5c6-de892f976afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a24651-5fea-4522-8c7d-5edb429472d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Volume volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 (7ea9eadd-dc1b-4ebb-937d-60ea727d78f3): created successfully Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a24651-5fea-4522-8c7d-5edb429472d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Flow 'volume_create_manager' (ddeaff69-4e56-409a-a158-c43df099394e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-465d9173-6a54-4ba2-9835-ae6c30b4ae93 tempest-SnapshotsActionsTest-40045068 None] Created volume successfully. Nov 06 21:22:22 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd Nov 06 21:22:22 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:22 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.437s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Deleted volume successfully. Nov 06 21:22:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fc8c1c96-4640-4d9f-aa5d-24cfb1452bf9 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-6719474b-2e96-48c6-8575-0d623d4aeb97-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:23 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd" returned: 0 in 0.437s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:23 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 Nov 06 21:22:23 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:23 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13" returned: 0 in 0.384s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:23 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13 Nov 06 21:22:23 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (fe04cc10-934e-4032-bf17-3732cbddb9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09d37b1-d847-4764-b284-76f5fefcfd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09d37b1-d847-4764-b284-76f5fefcfd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-109233337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61ae111-5721-4adb-b8ef-8f9a846374e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:24Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39518885-fb70-4293-b457-db5b2a76b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39518885-fb70-4293-b457-db5b2a76b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76b2139-402f-4596-96e1-60612504e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76b2139-402f-4596-96e1-60612504e738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61ae111-5721-4adb-b8ef-8f9a846374e0', 'volume_name': 'volume-e61ae111-5721-4adb-b8ef-8f9a846374e0', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410e5c3f-22ea-483f-b92c-ba0dd3829c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410e5c3f-22ea-483f-b92c-ba0dd3829c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71bea21-934d-42f5-bae5-0b9be4b93203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Volume e61ae111-5721-4adb-b8ef-8f9a846374e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61ae111-5721-4adb-b8ef-8f9a846374e0', 'volume_size': 1} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-109233337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61ae111-5721-4adb-b8ef-8f9a846374e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:24Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Creating volume e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:23 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:23 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd.281feb3c-632c-4ed3-b4c9-34083b12dd13" returned: 0 in 0.315s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:23 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 1073741824 Nov 06 21:22:23 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-281feb3c-632c-4ed3-b4c9-34083b12dd13" released by "_delete_snapshot" :: held 1.911s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-7ff83933-f059-4ecd-a827-3f83e54002dd" released by "delete_snapshot" :: held 1.971s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-e7d0acc0-849a-4615-b7ba-4df892b48fc4" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-e7d0acc0-849a-4615-b7ba-4df892b48fc4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-5878797d-d43b-4763-8966-2d7f13f6321c" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-5878797d-d43b-4763-8966-2d7f13f6321c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Deleting offline snapshot 5878797d-d43b-4763-8966-2d7f13f6321c of volume e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] snapshot_file for this snap is: volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5807ee4-8d37-4523-80f0-9427d1ac181e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:24 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c Nov 06 21:22:24 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:24 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 1073741824" returned: 0 in 0.626s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:24 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 Nov 06 21:22:24 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:24 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c" returned: 0 in 0.472s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b36c0d0-a45d-4fb0-891f-9b3d2aa1b3b2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:24 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 Nov 06 21:22:24 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:24 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0" returned: 0 in 0.296s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.690s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71bea21-934d-42f5-bae5-0b9be4b93203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61ae111-5721-4adb-b8ef-8f9a846374e0', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2831778-ac3b-41cc-b447-e8010ddc2ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Creating offline snapshot e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Volume volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 (e61ae111-5721-4adb-b8ef-8f9a846374e0): created successfully Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2831778-ac3b-41cc-b447-e8010ddc2ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (fe04cc10-934e-4032-bf17-3732cbddb9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c8dc21-f185-42fe-bb72-9788342176f5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-22d16009-ae78-4591-bb78-e833ccc0048a tempest-VolumesSnapshotTestJSON-267030942 None] Created volume successfully. Nov 06 21:22:24 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 Nov 06 21:22:24 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:24 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4" returned: 0 in 0.499s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:25 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c Nov 06 21:22:25 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:25 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" returned: 0 in 0.430s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:25 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 1G Nov 06 21:22:25 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:25 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c" returned: 0 in 0.373s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:25 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c Nov 06 21:22:25 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:25 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4.5878797d-d43b-4763-8966-2d7f13f6321c" returned: 0 in 0.282s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:25 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 1G" returned: 0 in 0.487s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-5878797d-d43b-4763-8966-2d7f13f6321c" released by "_delete_snapshot" :: held 1.827s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-e7d0acc0-849a-4615-b7ba-4df892b48fc4" released by "delete_snapshot" :: held 1.878s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:25 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:25 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:25 devstack cinder-volume[87450]: WARNING cinder.quota [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-961319366 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-961319366, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:25 devstack cinder-volume[87450]: WARNING cinder.quota [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-961319366 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-961319366, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['6376690e-98fc-4873-96c4-011461caa331', '68fe10f7-d080-406d-a19a-6b31bbcd785f', '098e3c24-0d07-4c71-870b-8e529a1b8846', '08bd940c-2d86-4299-9d40-d9e248487b76'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['ec9ad73a-cf09-4c4a-add7-7716920902a4', '75c40dbd-2fd7-4b48-811a-364773e527d1', '5b5337fd-0dc9-4ca8-8b53-d3a69b0517c6', '51bb286f-0b05-4191-9c64-d78368147de9'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:26 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.460s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:26 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 is being set with open permissions: ugo+rw Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:26 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3c531686-4e21-4871-bfec-f23c1701a7a4 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 43806393-4b75-4110-8c2a-5093fc7e198d: deleted successfully Nov 06 21:22:26 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.271s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:26 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.info Nov 06 21:22:26 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.info" returned: 0 in 0.285s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:26 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.info is being set with open permissions: ugo+rw Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:26 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.info Nov 06 21:22:26 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-7ff83933-f059-4ecd-a827-3f83e54002dd" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-7ff83933-f059-4ecd-a827-3f83e54002dd" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b22b2ef-e6ef-490c-a55b-569adf80ac26]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd Nov 06 21:22:27 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.info" returned: 0 in 0.375s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.228s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Creating offline snapshot c936352e-acca-4c06-9393-3e5e27b774bf of volume e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2773f213-5701-48a6-a4b0-c78170d6402e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4cf4c3b8-3c30-4cd8-947b-d0400549cc36 tempest-SnapshotsActionsTest-40045068 None] Create snapshot completed successfully Nov 06 21:22:27 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 Nov 06 21:22:27 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd" returned: 0 in 0.461s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd Nov 06 21:22:27 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0" returned: 0 in 0.462s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf 1G Nov 06 21:22:27 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ff83933-f059-4ecd-a827-3f83e54002dd" returned: 0 in 0.306s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-7ff83933-f059-4ecd-a827-3f83e54002dd" released by "delete_volume" :: held 0.869s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-e7d0acc0-849a-4615-b7ba-4df892b48fc4" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-e7d0acc0-849a-4615-b7ba-4df892b48fc4" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9fa5b2-31b0-4650-bb72-53b5bd02152a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 Nov 06 21:22:28 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf 1G" returned: 0 in 0.634s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf Nov 06 21:22:28 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4" returned: 0 in 0.517s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4 Nov 06 21:22:28 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf" returned: 0 in 0.478s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf is being set with open permissions: ugo+rw Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7d0acc0-849a-4615-b7ba-4df892b48fc4" returned: 0 in 0.422s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf Nov 06 21:22:28 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-e7d0acc0-849a-4615-b7ba-4df892b48fc4" released by "delete_volume" :: held 1.027s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:28 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['23357117-6969-4f56-9d06-42a7b32e52de'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:29 devstack cinder-volume[87450]: WARNING cinder.quota [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-961319366 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-961319366, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['85eb15d4-a881-458e-873f-87097ea76be1', 'db00e032-dc61-4610-aa8a-adb73b0d8571', 'd5f849d5-ddc7-454a-bd0a-687ea8f27a82', '3ae2d831-3df9-405c-afa6-a0ae5ee2ab4e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:29 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf" returned: 0 in 0.372s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.info Nov 06 21:22:29 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['8c6d8666-5f10-4b96-b76a-fc2828762201', '4b49475f-e40d-4abd-bcdb-810862899b38', 'ddd4c11c-4710-4012-a5a2-62c70f9c7d55', 'b1901d57-2a9e-4209-8831-acfe9dc9012f'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:29 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.info" returned: 0 in 0.373s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.info is being set with open permissions: ugo+rw Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.info Nov 06 21:22:29 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-16c6cafb-23e7-477a-a242-1769e4ca5c55 tempest-GroupSnapshotsTest-1575930250 None] Delete group completed successfully. Nov 06 21:22:29 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.info" returned: 0 in 0.427s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.885s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Creating offline snapshot f56941e2-4732-45cb-bcb6-32a4cf4b4b32 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6c37b7e4-d63b-45bf-a888-74046b38b3d5 tempest-VolumesSnapshotTestJSON-267030942 None] Create snapshot completed successfully Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b5c74c-fe70-46ef-bbe8-4bb73ac23654]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:30 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:30 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:30 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.407s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:30 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 1G Nov 06 21:22:30 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c9546e4f-7aa4-446f-a0c5-f1bf15abfe0c tempest-GroupSnapshotsTest-1575930250 None] Group tempest-GroupSnapshotsTest-Group-467892158: creating Nov 06 21:22:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c9546e4f-7aa4-446f-a0c5-f1bf15abfe0c tempest-GroupSnapshotsTest-1575930250 None] Group tempest-GroupSnapshotsTest-Group-467892158: created successfully Nov 06 21:22:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c9546e4f-7aa4-446f-a0c5-f1bf15abfe0c tempest-GroupSnapshotsTest-1575930250 None] Create group completed successfully. Nov 06 21:22:31 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 1G" returned: 0 in 0.636s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:31 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 Nov 06 21:22:31 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:31 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32" returned: 0 in 0.365s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:31 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 is being set with open permissions: ugo+rw Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:31 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 Nov 06 21:22:31 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:31 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32" returned: 0 in 0.291s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a5561895-074b-408d-bf8c-0384ad2bc302 tempest-SnapshotsActionsTest-40045068 None] Create snapshot completed successfully Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (0225991e-c0aa-4c1a-aaa8-1acecdb5e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7306e4-9aaa-46b9-8989-25fe180b9c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7306e4-9aaa-46b9-8989-25fe180b9c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1777558314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86e50eb8f0648c19a777f05cc6e1a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c936352e-acca-4c06-9393-3e5e27b774bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:32Z,use_quota=True,user_id='73a65d13bb3c49478bf54e3b2648bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092e98dd-080b-4024-b89e-dc886f9adcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092e98dd-080b-4024-b89e-dc886f9adcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fad8ab6-1f58-4300-9c85-59320d0aac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fad8ab6-1f58-4300-9c85-59320d0aac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17', 'volume_name': 'volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17', 'volume_size': 1, 'snapshot_id': 'c936352e-acca-4c06-9393-3e5e27b774bf'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fb08bd-60b1-425c-836c-bf40cc5f3d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fb08bd-60b1-425c-836c-bf40cc5f3d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb812a-9165-4364-8bf9-7f1f3ea52075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Volume dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17', 'volume_size': 1, 'snapshot_id': 'c936352e-acca-4c06-9393-3e5e27b774bf'} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-c936352e-acca-4c06-9393-3e5e27b774bf-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-c936352e-acca-4c06-9393-3e5e27b774bf-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Creating volume dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 from snapshot c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] snapshot: c936352e-acca-4c06-9393-3e5e27b774bf, volume: dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab8df8e-edf3-46ad-82cd-65bd8fbd4428]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:32 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf Nov 06 21:22:32 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-f56941e2-4732-45cb-bcb6-32a4cf4b4b32-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-f56941e2-4732-45cb-bcb6-32a4cf4b4b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-f56941e2-4732-45cb-bcb6-32a4cf4b4b32" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-f56941e2-4732-45cb-bcb6-32a4cf4b4b32" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Deleting offline snapshot f56941e2-4732-45cb-bcb6-32a4cf4b4b32 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] snapshot_file for this snap is: volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[688721ad-f629-4187-aaa8-b7ba63494b5d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:32 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 Nov 06 21:22:32 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:33 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf" returned: 0 in 0.880s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e61ae111-5721-4adb-b8ef-8f9a846374e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a95e533-9f64-40e9-b844-ff7f9b53c3ef]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (047bfc02-916b-4199-9c73-918106abd6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3a4105-4416-4c3c-8b89-7cc74d72c7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3a4105-4416-4c3c-8b89-7cc74d72c7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-872967691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db842fa7-81cf-40d8-8b63-39eb99cda496,host='devstack@QuobyteHD#QuobyteHD',id=91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:33Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d765a21f-71cb-43c7-a164-8d110ae155c5),volume_type_id=d765a21f-71cb-43c7-a164-8d110ae155c5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b078ea-c559-44cf-b6cf-39a6991530a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:33 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b078ea-c559-44cf-b6cf-39a6991530a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002eee76-bf4c-4702-8d93-3ebb1fe14f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002eee76-bf4c-4702-8d93-3ebb1fe14f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5', 'volume_name': 'volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:33 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 Nov 06 21:22:33 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8297c9a3-36cc-4c08-aabe-3eea0c9f5adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8297c9a3-36cc-4c08-aabe-3eea0c9f5adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b426ad-e4a0-4ec3-ad46-819a40b86589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Volume 91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5', 'volume_size': 1} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32" returned: 0 in 0.715s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be1ddb-9850-44ac-b500-01ff820d926c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:33 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:33 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:33 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0" returned: 0 in 0.668s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:22:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:33 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 Nov 06 21:22:33 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:34 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.500s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:34 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 Nov 06 21:22:34 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:34 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32" returned: 0 in 0.581s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:34 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32 Nov 06 21:22:34 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:35 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.f56941e2-4732-45cb-bcb6-32a4cf4b4b32" returned: 0 in 0.561s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-f56941e2-4732-45cb-bcb6-32a4cf4b4b32" released by "_delete_snapshot" :: held 2.709s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" released by "delete_snapshot" :: held 2.760s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:35 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Created reservations ['9730edd4-dbb7-4609-bc00-ee90a5f9e21c', 'c72c476e-db14-42f8-8de2-a7e25207b126', '05b891e1-2aad-42f8-b5ba-80c6df34c37d', 'a0d5ce2d-08f1-4b49-9e4e-12322b91d4f5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Delete snapshot completed successfully. Nov 06 21:22:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9529731f-e503-4351-81f6-81569a1830ce tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-f56941e2-4732-45cb-bcb6-32a4cf4b4b32-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:44 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" returned: 0 in 10.741s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0, size 1024.00 MB, duration 10.74 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:44 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Converted 1024.00 MB image at 95.33 MB/s Nov 06 21:22:44 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 is being set with open permissions: ugo+rw Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:44 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 Nov 06 21:22:44 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:44 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" returned: 0 in 0.299s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" released by "_copy_volume_from_snapshot" :: held 12.740s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-c936352e-acca-4c06-9393-3e5e27b774bf-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" released by "_create_volume_from_snapshot" :: held 12.827s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.849s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.458s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db842fa7-81cf-40d8-8b63-39eb99cda496,created_at=2026-11-06T20:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-872967691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db842fa7-81cf-40d8-8b63-39eb99cda496,host='devstack@QuobyteHD#QuobyteHD',id=91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9122ce9ea1764872bea4ee18233db23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:33Z,use_quota=True,user_id='fe53170a815c48bf9b4fd7775344d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d765a21f-71cb-43c7-a164-8d110ae155c5),volume_type_id=d765a21f-71cb-43c7-a164-8d110ae155c5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Creating volume 91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:44 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:44 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 1073741824 Nov 06 21:22:44 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb812a-9165-4364-8bf9-7f1f3ea52075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17', 'volume_size': 1, 'snapshot_id': 'c936352e-acca-4c06-9393-3e5e27b774bf'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fc4548-576d-4a77-a0a6-e76d7e4ad88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Volume volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 (dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17): created successfully Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fc4548-576d-4a77-a0a6-e76d7e4ad88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Flow 'volume_create_manager' (0225991e-c0aa-4c1a-aaa8-1acecdb5e85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7251a5e5-5eee-4f85-a67f-027f1ab73e7f tempest-VolumesSnapshotTestJSON-267030942 None] Created volume successfully. Nov 06 21:22:45 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 1073741824" returned: 0 in 0.509s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:45 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 Nov 06 21:22:45 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:45 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" returned: 0 in 0.298s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.065s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b426ad-e4a0-4ec3-ad46-819a40b86589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc325708-ee2c-4996-83c2-e870f52d433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Creating offline snapshot 01c96115-521d-48d7-982e-cfa51355dc50 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Volume volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 (91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5): created successfully Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc325708-ee2c-4996-83c2-e870f52d433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Flow 'volume_create_manager' (047bfc02-916b-4199-9c73-918106abd6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da2b8a-4bd0-4b55-a76a-2ac33bcc5eae]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b4287b44-aa63-448d-8ec8-a5fa58340bb4 tempest-GroupSnapshotsTest-1575930250 None] Created volume successfully. Nov 06 21:22:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:46 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:46 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a483187-645d-4dfd-853c-9a77bf0fed27]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:46 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 Nov 06 21:22:46 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:46 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.458s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:46 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 1G Nov 06 21:22:46 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:46 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" returned: 0 in 0.473s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:46 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17 Nov 06 21:22:46 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] GroupSnapshot 1622209e-2fc4-41b9-91cf-2b294417e00f: creating. Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Group snapshot 1622209e-2fc4-41b9-91cf-2b294417e00f: creating. {{(pid=87450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:22:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:46 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" returned: 0 in 0.423s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17" released by "delete_volume" :: held 0.951s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:47 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 1G" returned: 0 in 0.671s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:47 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 Nov 06 21:22:47 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['addfea58-c6b3-4558-b3b5-241ee2e9aa6a', '2e62170b-3fb5-49bc-8735-312ffafd7294', 'a8da1a60-0ad5-4a64-8f58-52923efb2219', '6f36babb-bdff-4d4a-91f4-d34d01847991'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:47 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:47 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:47 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50" returned: 0 in 0.411s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:47 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 is being set with open permissions: ugo+rw Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:47 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 Nov 06 21:22:47 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:47 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.293s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Deleted volume successfully. Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae1c0b16-51d0-4eb4-8600-b3a117fefe82 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-dadc1b9e-9199-4e4a-b4a2-0b6fbe65bc17-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:47 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50" returned: 0 in 0.314s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.928s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Creating offline snapshot 1b2245ab-a876-4295-8596-76bf0aad2ced of volume 91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9ee63d90-7725-4938-b83d-47f7f8acdf73 tempest-SnapshotsActionsTest-40045068 None] Create snapshot completed successfully Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b02ba-e7d3-4edb-9e7f-e8137de8d647]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:47 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 Nov 06 21:22:47 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:48 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" returned: 0 in 0.397s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:48 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced 1G Nov 06 21:22:48 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-c936352e-acca-4c06-9393-3e5e27b774bf-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-c936352e-acca-4c06-9393-3e5e27b774bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-e61ae111-5721-4adb-b8ef-8f9a846374e0" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-e61ae111-5721-4adb-b8ef-8f9a846374e0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-c936352e-acca-4c06-9393-3e5e27b774bf" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-c936352e-acca-4c06-9393-3e5e27b774bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Deleting offline snapshot c936352e-acca-4c06-9393-3e5e27b774bf of volume e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] snapshot_file for this snap is: volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ddcdcf-c1f8-4446-823d-20f3ba239c5a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:48 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf Nov 06 21:22:48 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:48 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced 1G" returned: 0 in 0.521s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:48 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf" returned: 0 in 0.407s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e61ae111-5721-4adb-b8ef-8f9a846374e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:48 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced Nov 06 21:22:48 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-01c96115-521d-48d7-982e-cfa51355dc50-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23ace3-0da9-4a96-9b63-4db1fad22096]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-01c96115-521d-48d7-982e-cfa51355dc50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-01c96115-521d-48d7-982e-cfa51355dc50" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-01c96115-521d-48d7-982e-cfa51355dc50" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Deleting offline snapshot 01c96115-521d-48d7-982e-cfa51355dc50 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] snapshot_file for this snap is: volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[29886768-ee7a-4cbb-919b-0796e624b061]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 Nov 06 21:22:49 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 Nov 06 21:22:49 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced Nov 06 21:22:49 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50" returned: 0 in 0.387s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:49 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[469262a6-db6e-44da-ba68-fc00dd3bf471]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced" returned: 0 in 0.288s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.info Nov 06 21:22:49 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0" returned: 0 in 0.643s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:49 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf Nov 06 21:22:49 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.info" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.info Nov 06 21:22:49 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.422s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 Nov 06 21:22:49 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf" returned: 0 in 0.390s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf Nov 06 21:22:49 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:50 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.info" returned: 0 in 0.287s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-689085b0-2cf8-4351-9e79-6ee8978055ae tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 1622209e-2fc4-41b9-91cf-2b294417e00f: created successfully Nov 06 21:22:50 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0.c936352e-acca-4c06-9393-3e5e27b774bf" returned: 0 in 0.296s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-c936352e-acca-4c06-9393-3e5e27b774bf" released by "_delete_snapshot" :: held 1.891s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:50 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-e61ae111-5721-4adb-b8ef-8f9a846374e0" released by "delete_snapshot" :: held 1.916s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50" returned: 0 in 0.418s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:50 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50 Nov 06 21:22:50 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['cf5343b3-70fc-4b54-bf56-d944885f9dc2', '3e43c5b3-e91d-470b-85aa-d5215dfd0cec', 'aa54d068-3da5-4455-b0b0-86314ed2daa7', '096f7a23-1822-4169-bdfc-94b9d82cba63'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Delete snapshot completed successfully. Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40169f6c-73d0-4814-94fa-7b38af9e3119 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-c936352e-acca-4c06-9393-3e5e27b774bf-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:50 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.01c96115-521d-48d7-982e-cfa51355dc50" returned: 0 in 0.265s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-e61ae111-5721-4adb-b8ef-8f9a846374e0-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-01c96115-521d-48d7-982e-cfa51355dc50" released by "_delete_snapshot" :: held 1.641s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" released by "delete_snapshot" :: held 1.673s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-e61ae111-5721-4adb-b8ef-8f9a846374e0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-e61ae111-5721-4adb-b8ef-8f9a846374e0" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-e61ae111-5721-4adb-b8ef-8f9a846374e0" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da17f8bf-2eca-4369-93c0-2751a2785ab6]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Created reservations ['312764e9-4ea1-47ed-a8a0-b4bb108cbcff', 'c626ea7a-87e2-4cdb-9bc1-53fef50e76a4', 'ab5b990a-b5fb-4fb0-ad91-2e4e3ed5f54e', '67c19d3e-574e-4bc7-88aa-0873ee9fb789'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Delete snapshot completed successfully. Nov 06 21:22:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bd4fb143-a32f-4a4a-a1c2-0f65e58b1d4d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-01c96115-521d-48d7-982e-cfa51355dc50-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:50 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 Nov 06 21:22:50 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0" returned: 0 in 0.409s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0 Nov 06 21:22:51 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 1622209e-2fc4-41b9-91cf-2b294417e00f: deleting Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 1622209e-2fc4-41b9-91cf-2b294417e00f: deleting {{(pid=87450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:22:51 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e61ae111-5721-4adb-b8ef-8f9a846374e0" returned: 0 in 0.322s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Creating offline snapshot 102e310d-054b-435a-817f-07c797b29832 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-e61ae111-5721-4adb-b8ef-8f9a846374e0" released by "delete_volume" :: held 0.856s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-1b2245ab-a876-4295-8596-76bf0aad2ced" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dadb08c-f4cf-46db-b333-fab6da5545ed]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-1b2245ab-a876-4295-8596-76bf0aad2ced" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Deleting offline snapshot 1b2245ab-a876-4295-8596-76bf0aad2ced of volume 91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] snapshot_file for this snap is: volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cba196-cf8c-442b-abb3-8153159323f4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['c714ac59-495e-4428-bf90-448fba5183b3', 'b600744c-7633-4a84-9135-3f5c8d88fd35', '828df73f-3803-4f24-b502-35f379ca04a7', '32a0086c-9f46-4a4e-8f92-1484a229c969'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:51 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:51 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced Nov 06 21:22:51 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:51 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.409s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 1G Nov 06 21:22:51 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced" returned: 0 in 0.405s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:52 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.320s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Deleted volume successfully. Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd63f110-c536-4ce3-868b-999b0d2e09a4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f1dc541e-8f44-471d-ae5f-cd18a55c2070 tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-e61ae111-5721-4adb-b8ef-8f9a846374e0-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:52 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 Nov 06 21:22:52 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 1G" returned: 0 in 0.520s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" returned: 0 in 0.421s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced Nov 06 21:22:52 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832" returned: 0 in 0.345s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 is being set with open permissions: ugo+rw Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 Nov 06 21:22:52 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-316c5385-b2ff-45cb-bb74-1058b2870824-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:52 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced" returned: 0 in 0.384s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-316c5385-b2ff-45cb-bb74-1058b2870824-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:52 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced Nov 06 21:22:52 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "cinder-quobyte-316c5385-b2ff-45cb-bb74-1058b2870824" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-316c5385-b2ff-45cb-bb74-1058b2870824" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ead7fee-e462-4395-bc26-d0629e1d0410]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:53 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832" returned: 0 in 0.309s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:53 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 Nov 06 21:22:53 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.758s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-cfe8c367-b447-4f40-bca9-8965f51abee2 tempest-SnapshotsActionsTest-40045068 None] Create snapshot completed successfully Nov 06 21:22:53 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5.1b2245ab-a876-4295-8596-76bf0aad2ced" returned: 0 in 0.337s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-1b2245ab-a876-4295-8596-76bf0aad2ced" released by "_delete_snapshot" :: held 1.693s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" released by "delete_snapshot" :: held 1.739s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:53 devstack cinder-volume[87450]: WARNING cinder.quota [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-616371854 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-616371854, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:53 devstack cinder-volume[87450]: WARNING cinder.quota [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-616371854 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-616371854, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['7215c148-c7cd-499b-a1fa-bc4d2e2eb04d', '102c676a-3759-445e-9265-5885c55d7680', '6b8edef2-a3b8-4f40-8efd-3c4b0cf9fb50', 'b30372fb-5121-47bb-a2f2-1e01169cd421'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-85d10290-9bcf-439a-b1de-20898b7ea8c7 tempest-GroupSnapshotsTest-1575930250 None] group_snapshot 1622209e-2fc4-41b9-91cf-2b294417e00f: deleted successfully Nov 06 21:22:53 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824" returned: 0 in 0.417s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:53 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824 Nov 06 21:22:53 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-102e310d-054b-435a-817f-07c797b29832-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-102e310d-054b-435a-817f-07c797b29832-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-102e310d-054b-435a-817f-07c797b29832" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-102e310d-054b-435a-817f-07c797b29832" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Deleting offline snapshot 102e310d-054b-435a-817f-07c797b29832 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] snapshot_file for this snap is: volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e682cc3-72bd-480d-b41e-a7be5d977602]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:53 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-316c5385-b2ff-45cb-bb74-1058b2870824" returned: 0 in 0.304s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-quobyte-316c5385-b2ff-45cb-bb74-1058b2870824" released by "delete_volume" :: held 0.804s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:53 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 Nov 06 21:22:53 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Created reservations ['4ef36e3b-f091-471b-a50c-17ed80c8e954', 'c653a518-42b0-4072-b878-fd0ab40a38bd', 'e94bec12-38e6-4e76-9c2d-7d838c244adc', 'e89d0388-ce53-4031-91ea-026240912268'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:53 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:53 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "cinder-quobyte-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b34518-2040-47c2-b6f9-9b8c40f1e0a0]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:54 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832" returned: 0 in 0.473s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd0487-d196-4d0d-94fa-a84ac2cef592]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:54 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.323s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:54 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Deleted volume successfully. Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ecc7eb79-1c5d-4e9b-8db4-32dd1bdb308e tempest-VolumesSnapshotTestJSON-267030942 None] Lock "cinder-316c5385-b2ff-45cb-bb74-1058b2870824-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:54 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 Nov 06 21:22:54 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:54 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:54 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:54 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" returned: 0 in 0.476s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:54 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5 Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.472s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:54 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:54 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 Nov 06 21:22:54 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:55 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" returned: 0 in 0.426s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Lock "cinder-quobyte-91b49d5e-fb3b-4c94-8a3f-b8b6035a91e5" released by "delete_volume" :: held 0.994s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['7ee24965-e994-4992-8a4b-522ec63848d7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:55 devstack cinder-volume[87450]: WARNING cinder.quota [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-616371854 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-616371854, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Created reservations ['c9eeda91-4166-4b75-a30d-ad83a76fd9f2', 'd4b78856-2a9c-4ff8-97af-e65954dcb81b', '36974ea4-4b80-42c4-8ba6-d8918ecc784e', 'b571f8bb-6827-490b-9fce-93480b9f58cd'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:55 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832" returned: 0 in 0.719s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:55 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832 Nov 06 21:22:55 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:55 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:22:55 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:55 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.301s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:55 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6636ebba-5461-4b47-b0ba-3bfdf64a0c42 tempest-GroupSnapshotsTest-1575930250 None] Delete group completed successfully. Nov 06 21:22:55 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.102e310d-054b-435a-817f-07c797b29832" returned: 0 in 0.400s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-102e310d-054b-435a-817f-07c797b29832" released by "_delete_snapshot" :: held 2.221s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" released by "delete_snapshot" :: held 2.258s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:55 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Created reservations ['5a273da2-eb8f-4aa8-8041-5ff815dfcea1', 'b9a1f8ca-ab1e-4047-9333-75be783bbc96', '7f0c8c40-16d6-4073-b23d-6d10f1fa0749', 'c810739e-73e6-4ca0-8154-4c5707e470ff'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:56 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Delete snapshot completed successfully. Nov 06 21:22:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-24a6e113-7ece-4e38-9f17-ed49dbc0873d tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-102e310d-054b-435a-817f-07c797b29832-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Creating offline snapshot 4130172e-2f4f-48d1-839e-b2fb2a7eef08 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ba691-0253-45e3-8fd7-887a9dc7e8aa]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:22:57 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 1G Nov 06 21:22:57 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 1G" returned: 0 in 0.643s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 Nov 06 21:22:58 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08" returned: 0 in 0.381s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 is being set with open permissions: ugo+rw Nov 06 21:22:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 Nov 06 21:22:58 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08" returned: 0 in 0.293s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f3b9d1e8-09ab-43ce-b107-e6f2482e4897 tempest-SnapshotsActionsTest-40045068 None] Create snapshot completed successfully Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-4130172e-2f4f-48d1-839e-b2fb2a7eef08-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-4130172e-2f4f-48d1-839e-b2fb2a7eef08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Acquiring lock "cinder-quobyte-4130172e-2f4f-48d1-839e-b2fb2a7eef08" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-4130172e-2f4f-48d1-839e-b2fb2a7eef08" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Deleting offline snapshot 4130172e-2f4f-48d1-839e-b2fb2a7eef08 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] snapshot_file for this snap is: volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa166cf3-e705-4b36-858a-c4cfde5d586d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 Nov 06 21:22:59 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:00 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08" returned: 0 in 0.482s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ad489b-9bdc-4d22-b4e3-ff92ed0bed15]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:00 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:23:00 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:00 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.507s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:00 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 Nov 06 21:23:00 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:01 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08" returned: 0 in 0.573s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:01 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08 Nov 06 21:23:01 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:01 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.4130172e-2f4f-48d1-839e-b2fb2a7eef08" returned: 0 in 0.535s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-4130172e-2f4f-48d1-839e-b2fb2a7eef08" released by "_delete_snapshot" :: held 2.258s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:01 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" released by "delete_snapshot" :: held 2.291s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:02 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Created reservations ['7a1fb660-87b5-4593-9e45-7ebd50558193', 'a99da9a5-fde8-40cc-bd15-5200ed76c3c2', 'fc11487b-e2f9-45fa-9b83-a8acb5cde83d', 'cb63a289-a032-4b1b-956f-8a0850ddc990'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Delete snapshot completed successfully. Nov 06 21:23:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8737e37-cffb-4cc5-bfbd-76cb497e1a91 tempest-SnapshotsActionsTest-848364921 None] Lock "cinder-4130172e-2f4f-48d1-839e-b2fb2a7eef08-delete_snapshot" released by "delete_snapshot" :: held 2.633s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "cinder-e1b1145d-6fb4-4f22-996c-a92cf4fcfb62-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-e1b1145d-6fb4-4f22-996c-a92cf4fcfb62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "cinder-quobyte-e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-quobyte-e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Deleting offline snapshot e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 of volume 7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] snapshot_file for this snap is: volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924b580-798e-4f7c-9c30-40dbb8ab6e80]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:04 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:23:04 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:04 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.643s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4c6bd1-71ed-4e89-bbb7-e84c40df7a00]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:04 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 Nov 06 21:23:04 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:05 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" returned: 0 in 0.491s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:05 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:23:05 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-07e4408f-9755-4483-8673-22ffb48b0d41 tempest-GroupSnapshotsV319Test-1297695712 None] Group tempest-GroupSnapshotsV319Test-Group-504792220: creating Nov 06 21:23:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-07e4408f-9755-4483-8673-22ffb48b0d41 tempest-GroupSnapshotsV319Test-1297695712 None] Group tempest-GroupSnapshotsV319Test-Group-504792220: created successfully Nov 06 21:23:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-07e4408f-9755-4483-8673-22ffb48b0d41 tempest-GroupSnapshotsV319Test-1297695712 None] Create group completed successfully. Nov 06 21:23:05 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.441s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:05 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62 Nov 06 21:23:05 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:05 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3.e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" returned: 0 in 0.300s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-quobyte-e1b1145d-6fb4-4f22-996c-a92cf4fcfb62" released by "_delete_snapshot" :: held 2.061s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" released by "delete_snapshot" :: held 2.099s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:06 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Created reservations ['6d63fdc3-caf3-4756-8ab2-49e39995e351', '4abf14df-482d-41db-b1cd-1c71b61e58d8', '904f721b-5b5b-46be-9a44-13ddab41b231', 'bbc8f746-899a-42d4-ba6e-18c5e8153ff5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:06 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Delete snapshot completed successfully. Nov 06 21:23:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d3b741a4-0a77-42b9-b840-b4d363fd26bc tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-e1b1145d-6fb4-4f22-996c-a92cf4fcfb62-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:06 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-f116c0f1-2659-4baf-bf70-3f2eaecdb9b3 req-25cac462-9be4-41c7-827c-75ecc0d587d1 tempest-AttachVolumeNegativeTest-603549752 None] Terminate volume connection completed successfully. Nov 06 21:23:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-f116c0f1-2659-4baf-bf70-3f2eaecdb9b3 req-25cac462-9be4-41c7-827c-75ecc0d587d1 tempest-AttachVolumeNegativeTest-603549752 None] Deleting attachment 0f51ea02-c9ba-4c6a-8a56-a09c78ceb61f. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "cinder-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca35e590-1290-4030-bf41-6150d1b82432]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Flow 'volume_create_manager' (ce5db881-eb32-480b-bc7f-f8b6d400d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf77c1bc-46ec-4545-b196-5318e04d3f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf77c1bc-46ec-4545-b196-5318e04d3f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452949522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=815b9164-abf5-49b7-b668-27d0a1e39610,host='devstack@QuobyteHD#QuobyteHD',id=9ecaa23d-b118-42c8-ace3-3f0943f625c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78bb967d9c5744eb9f83895e9e933a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:07Z,use_quota=True,user_id='ed4a31b1b6d848bb9477c6ba91dd4b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ef91035-75ae-44dc-8f39-55135c2ebe28),volume_type_id=5ef91035-75ae-44dc-8f39-55135c2ebe28)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c67060-3369-42fe-8aac-fd5b78ef154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c67060-3369-42fe-8aac-fd5b78ef154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf69ea32-4c50-4d9f-aa66-d09b16e15748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf69ea32-4c50-4d9f-aa66-d09b16e15748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecaa23d-b118-42c8-ace3-3f0943f625c4', 'volume_name': 'volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768cb97f-026e-47a3-a197-1cbb61abbcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768cb97f-026e-47a3-a197-1cbb61abbcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c258d16-1818-43af-8f15-6c63b9988d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Volume 9ecaa23d-b118-42c8-ace3-3f0943f625c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4', 'volume_size': 1} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=815b9164-abf5-49b7-b668-27d0a1e39610,created_at=2026-11-06T20:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452949522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=815b9164-abf5-49b7-b668-27d0a1e39610,host='devstack@QuobyteHD#QuobyteHD',id=9ecaa23d-b118-42c8-ace3-3f0943f625c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78bb967d9c5744eb9f83895e9e933a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:07Z,use_quota=True,user_id='ed4a31b1b6d848bb9477c6ba91dd4b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ef91035-75ae-44dc-8f39-55135c2ebe28),volume_type_id=5ef91035-75ae-44dc-8f39-55135c2ebe28)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Creating volume 9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:07 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:07 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 1073741824 Nov 06 21:23:07 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:07 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 Nov 06 21:23:07 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:08 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" returned: 0 in 0.553s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:08 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3 Nov 06 21:23:08 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:08 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 1073741824" returned: 0 in 0.690s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:08 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 Nov 06 21:23:08 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:08 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" returned: 0 in 0.577s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-quobyte-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3" released by "delete_volume" :: held 1.240s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Created reservations ['75328d4c-8acb-4303-86e4-f668e7a8350b', '12b9f804-d0ce-441e-a147-4b43a6bb919d', '9ed75c79-445c-4615-bd17-1485b928e350', '33d5179e-c466-42cf-8a20-c22daff7b030'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:08 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4" returned: 0 in 0.561s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:08 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:23:08 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c258d16-1818-43af-8f15-6c63b9988d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac63223c-57b7-4749-8cde-1848a2ecde5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Volume volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 (9ecaa23d-b118-42c8-ace3-3f0943f625c4): created successfully Nov 06 21:23:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac63223c-57b7-4749-8cde-1848a2ecde5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Flow 'volume_create_manager' (ce5db881-eb32-480b-bc7f-f8b6d400d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1a86fde4-1c90-40ce-9c4b-8c1586100bd5 tempest-GroupSnapshotsV319Test-1297695712 None] Created volume successfully. Nov 06 21:23:09 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:09 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Deleted volume successfully. Nov 06 21:23:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae512563-55f8-43b7-b729-809ea8775ba0 tempest-SnapshotsActionsTest-40045068 None] Lock "cinder-7ea9eadd-dc1b-4ebb-937d-60ea727d78f3-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] GroupSnapshot 0bc4fae1-37b4-43b3-aa38-c45831386b06: creating. Nov 06 21:23:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Group snapshot 0bc4fae1-37b4-43b3-aa38-c45831386b06: creating. {{(pid=87450) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:23:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Creating offline snapshot 06c7da09-adee-415f-a588-aa9cbb1fa72e of volume 9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:10 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0144a03-63c9-4ca9-be6a-f8c477aa0a80]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:10 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 Nov 06 21:23:10 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:11 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4" returned: 0 in 0.535s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e 1G Nov 06 21:23:11 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:23:11 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:11 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.396s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:23:11 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e 1G" returned: 0 in 0.580s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e Nov 06 21:23:11 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:11 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e" returned: 0 in 0.334s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:23:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:12 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e Nov 06 21:23:12 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:12 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e" returned: 0 in 0.308s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:12 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.info Nov 06 21:23:12 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:12 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.info" returned: 0 in 0.398s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:12 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:23:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:12 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.info Nov 06 21:23:12 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:13 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.info" returned: 0 in 0.325s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.645s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-20578edf-3dc9-4626-ae53-7352800e1996 tempest-GroupSnapshotsV319Test-1297695712 None] group_snapshot 0bc4fae1-37b4-43b3-aa38-c45831386b06: created successfully Nov 06 21:23:14 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] group_snapshot 0bc4fae1-37b4-43b3-aa38-c45831386b06: deleting Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] group_snapshot 0bc4fae1-37b4-43b3-aa38-c45831386b06: deleting {{(pid=87450) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Acquiring lock "cinder-quobyte-9ecaa23d-b118-42c8-ace3-3f0943f625c4" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "cinder-quobyte-9ecaa23d-b118-42c8-ace3-3f0943f625c4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Acquiring lock "cinder-quobyte-06c7da09-adee-415f-a588-aa9cbb1fa72e" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "cinder-quobyte-06c7da09-adee-415f-a588-aa9cbb1fa72e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Deleting offline snapshot 06c7da09-adee-415f-a588-aa9cbb1fa72e of volume 9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] snapshot_file for this snap is: volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9902ed-fa02-4644-9baf-c882028a0f3d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e Nov 06 21:23:14 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e" returned: 0 in 0.606s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:15 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c85cc-fd16-4bb2-a27b-99489ed5fffe]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 Nov 06 21:23:15 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4" returned: 0 in 0.540s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e Nov 06 21:23:16 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e" returned: 0 in 0.430s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e Nov 06 21:23:16 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4.06c7da09-adee-415f-a588-aa9cbb1fa72e" returned: 0 in 0.291s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "cinder-quobyte-06c7da09-adee-415f-a588-aa9cbb1fa72e" released by "_delete_snapshot" :: held 2.071s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "cinder-quobyte-9ecaa23d-b118-42c8-ace3-3f0943f625c4" released by "delete_snapshot" :: held 2.104s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=161,cinder:INSERT=51,cinder:UPDATE=166,cinder:DELETE=7 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=172,cinder:UPDATE=180,cinder:INSERT=40,cinder:DELETE=12 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:23:16 devstack cinder-volume[87450]: WARNING cinder.quota [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-546414482 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-546414482, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:16 devstack cinder-volume[87450]: WARNING cinder.quota [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-546414482 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-546414482, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:16 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] Created reservations ['aaa5a684-cfdd-4ada-a27d-9d3477c98583', '4897276a-5b63-4fa0-a716-1a0a48a0fdc3', '9d78d77f-6039-4299-8e2a-2beb977ecbd5', '653a4baa-13f1-4e8a-86f9-97f0bec0e704'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:17 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3ea06510-72a8-4a99-b324-d51486784389 tempest-GroupSnapshotsV319Test-1297695712 None] group_snapshot 0bc4fae1-37b4-43b3-aa38-c45831386b06: deleted successfully Nov 06 21:23:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Acquiring lock "cinder-quobyte-9ecaa23d-b118-42c8-ace3-3f0943f625c4" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "cinder-quobyte-9ecaa23d-b118-42c8-ace3-3f0943f625c4" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc7c7d-0861-45f6-8065-36b857a28174]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:18 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 Nov 06 21:23:18 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4" returned: 0 in 0.485s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:19 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4 Nov 06 21:23:19 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9ecaa23d-b118-42c8-ace3-3f0943f625c4" returned: 0 in 0.333s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "cinder-quobyte-9ecaa23d-b118-42c8-ace3-3f0943f625c4" released by "delete_volume" :: held 0.956s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Created reservations ['93e01bdb-e1a5-4dc7-82d1-882ab19ff325'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:19 devstack cinder-volume[87450]: WARNING cinder.quota [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-546414482 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-546414482, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Created reservations ['93c16aff-07a0-4db1-811b-d835ebccf9ca', 'fde3d969-41f5-4e61-85d1-e79ecc5702eb', '62cc3e01-40ee-41aa-8b7a-a9cbc8df4878', '4864c8f0-532c-46a7-8ba0-24a9ca44fba8'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:19 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:23:19 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:20 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.449s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:20 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-311c56f0-019d-40a4-b68e-f618f82f9620 tempest-GroupSnapshotsV319Test-1297695712 None] Delete group completed successfully. Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Flow 'volume_create_manager' (3513fbe0-85b5-4467-b327-97f841674feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b9ee71-97c2-4232-807e-6a7dea4c5ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b9ee71-97c2-4232-807e-6a7dea4c5ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1760235133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd48273-39eb-43d0-947c-565bfbd46f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2f3a6c132c4051b1452949ef4da399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:24Z,use_quota=True,user_id='026457b4683c4043a7939070538cc1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec224378-4be2-4fe4-b52a-2a3068357a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec224378-4be2-4fe4-b52a-2a3068357a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7037aa-da8f-48fd-a2b3-c25b07614fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7037aa-da8f-48fd-a2b3-c25b07614fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd48273-39eb-43d0-947c-565bfbd46f43', 'volume_name': 'volume-7cd48273-39eb-43d0-947c-565bfbd46f43', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22cf938-f504-4ee2-a4ca-ef8299dae1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22cf938-f504-4ee2-a4ca-ef8299dae1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0207840b-d7f3-4992-ac24-2cf1c1a62674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Volume 7cd48273-39eb-43d0-947c-565bfbd46f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd48273-39eb-43d0-947c-565bfbd46f43', 'volume_size': 1} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1760235133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd48273-39eb-43d0-947c-565bfbd46f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2f3a6c132c4051b1452949ef4da399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:24Z,use_quota=True,user_id='026457b4683c4043a7939070538cc1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Creating volume 7cd48273-39eb-43d0-947c-565bfbd46f43 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:24 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:24 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 1073741824 Nov 06 21:23:24 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:25 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 1073741824" returned: 0 in 0.754s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:25 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 Nov 06 21:23:25 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:25 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43" returned: 0 in 0.471s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0207840b-d7f3-4992-ac24-2cf1c1a62674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd48273-39eb-43d0-947c-565bfbd46f43', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3395a-ae77-45be-a841-a6ea7a8674b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Volume volume-7cd48273-39eb-43d0-947c-565bfbd46f43 (7cd48273-39eb-43d0-947c-565bfbd46f43): created successfully Nov 06 21:23:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3395a-ae77-45be-a841-a6ea7a8674b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Flow 'volume_create_manager' (3513fbe0-85b5-4467-b327-97f841674feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7fecbef7-fced-4e5c-8887-010308d8c502 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Created volume successfully. Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Acquiring lock "cinder-7cd48273-39eb-43d0-947c-565bfbd46f43-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "cinder-7cd48273-39eb-43d0-947c-565bfbd46f43-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Acquiring lock "cinder-quobyte-7cd48273-39eb-43d0-947c-565bfbd46f43" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "cinder-quobyte-7cd48273-39eb-43d0-947c-565bfbd46f43" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddae5a8b-9e49-4eed-ac3b-61884a7678df]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:27 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 Nov 06 21:23:27 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:27 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43" returned: 0 in 0.596s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:27 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43 Nov 06 21:23:27 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:28 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7cd48273-39eb-43d0-947c-565bfbd46f43" returned: 0 in 0.473s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "cinder-quobyte-7cd48273-39eb-43d0-947c-565bfbd46f43" released by "delete_volume" :: held 1.196s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Created reservations ['f777c220-3db7-41ee-895d-b74d58e2bb01', 'bbe0f47a-50db-478b-a427-c1d76b461f01', 'db9e2693-14c7-4ae0-ba47-0713fc1a5757', 'b33545ec-6ac7-45d5-b2b7-dac1c1fe7d1d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:28 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:23:28 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:28 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.351s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:28 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Deleted volume successfully. Nov 06 21:23:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-faff3190-bf22-453e-9e55-d4f06e702773 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "cinder-7cd48273-39eb-43d0-947c-565bfbd46f43-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Flow 'volume_create_manager' (9333b0fb-93a7-468f-9700-cbaf70792049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64476bf-d0f0-4e00-9936-60234968474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64476bf-d0f0-4e00-9936-60234968474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1566397073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188bfc83-3e0c-4100-9203-48905dfea3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2f3a6c132c4051b1452949ef4da399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:30Z,use_quota=True,user_id='026457b4683c4043a7939070538cc1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dbe8e3-542c-46dc-a76b-be20a4953aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dbe8e3-542c-46dc-a76b-be20a4953aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250601b-9151-4315-a499-35eb697beff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250601b-9151-4315-a499-35eb697beff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188bfc83-3e0c-4100-9203-48905dfea3b4', 'volume_name': 'volume-188bfc83-3e0c-4100-9203-48905dfea3b4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc6410c-81a7-44de-bdc3-0f24c34de307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc6410c-81a7-44de-bdc3-0f24c34de307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746a0a35-8b51-4d33-a007-5fa7a4298c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Volume 188bfc83-3e0c-4100-9203-48905dfea3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188bfc83-3e0c-4100-9203-48905dfea3b4', 'volume_size': 1} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1566397073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188bfc83-3e0c-4100-9203-48905dfea3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2f3a6c132c4051b1452949ef4da399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:30Z,use_quota=True,user_id='026457b4683c4043a7939070538cc1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Creating volume 188bfc83-3e0c-4100-9203-48905dfea3b4 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:30 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:30 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 1073741824 Nov 06 21:23:30 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:31 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 1073741824" returned: 0 in 0.726s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:31 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 Nov 06 21:23:31 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:31 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4" returned: 0 in 0.621s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746a0a35-8b51-4d33-a007-5fa7a4298c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188bfc83-3e0c-4100-9203-48905dfea3b4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a189085d-7daf-4993-9b3c-9280c7a38936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Volume volume-188bfc83-3e0c-4100-9203-48905dfea3b4 (188bfc83-3e0c-4100-9203-48905dfea3b4): created successfully Nov 06 21:23:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a189085d-7daf-4993-9b3c-9280c7a38936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Flow 'volume_create_manager' (9333b0fb-93a7-468f-9700-cbaf70792049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-20a2974e-ec2a-4132-94fa-f36b4bead608 tempest-VolumeQuotasAdminTestJSON-1147011610 None] Created volume successfully. Nov 06 21:23:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-546045ba-ce9b-415f-b170-e071fe9208c8 tempest-VolumeQuotasAdminTestJSON-840613881 None] Transfer volume completed successfully. Nov 06 21:23:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Acquiring lock "cinder-188bfc83-3e0c-4100-9203-48905dfea3b4-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Lock "cinder-188bfc83-3e0c-4100-9203-48905dfea3b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Acquiring lock "cinder-quobyte-188bfc83-3e0c-4100-9203-48905dfea3b4" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Lock "cinder-quobyte-188bfc83-3e0c-4100-9203-48905dfea3b4" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:35 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f529b-d2c0-48bc-a0f6-64079aee1c5d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:35 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 Nov 06 21:23:35 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:36 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4" returned: 0 in 0.714s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:36 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4 Nov 06 21:23:36 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:36 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-188bfc83-3e0c-4100-9203-48905dfea3b4" returned: 0 in 0.484s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Lock "cinder-quobyte-188bfc83-3e0c-4100-9203-48905dfea3b4" released by "delete_volume" :: held 1.299s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Created reservations ['044c301c-b46d-4449-a509-7e1ff4beab8d', 'e8170ee2-9ac5-4b1b-ac15-8fb83a71c44b', 'ab9cdef2-3607-4a8c-b292-ccb1d5095d0b', '9be929dc-48fa-4865-b01d-dfc63306269e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:36 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:23:36 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:37 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.425s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:37 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Deleted volume successfully. Nov 06 21:23:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a2cc62d9-4b19-4adc-a03c-fffece88a445 tempest-VolumeQuotasAdminTestJSON-1899217003 None] Lock "cinder-188bfc83-3e0c-4100-9203-48905dfea3b4-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Flow 'volume_create_manager' (9f1d99ef-2f37-4dd5-b843-8b10f98d1ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb44bdd-9288-49e3-8f44-7b5c348ac327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb44bdd-9288-49e3-8f44-7b5c348ac327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-623188171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1551499f83c84ab69ebf486c6869cfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:41Z,use_quota=True,user_id='abd863fcadf94970bb889958ffafbb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e6c087b-3bd8-4c0b-aaf9-8ec0133026f6),volume_type_id=3e6c087b-3bd8-4c0b-aaf9-8ec0133026f6)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaf3332-348f-436e-9d88-7c5e7cd133ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaf3332-348f-436e-9d88-7c5e7cd133ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b340f393-cd23-41e0-9996-9f5974eaa948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b340f393-cd23-41e0-9996-9f5974eaa948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782', 'volume_name': 'volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d67878c-421e-40ad-ac05-ef2cde0344f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d67878c-421e-40ad-ac05-ef2cde0344f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ab018b-0424-4882-8ec5-5096568b71b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume 0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782', 'volume_size': 1} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-623188171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1551499f83c84ab69ebf486c6869cfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:41Z,use_quota=True,user_id='abd863fcadf94970bb889958ffafbb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e6c087b-3bd8-4c0b-aaf9-8ec0133026f6),volume_type_id=3e6c087b-3bd8-4c0b-aaf9-8ec0133026f6)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Creating volume 0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:41 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:41 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 1073741824 Nov 06 21:23:41 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Flow 'volume_create_manager' (6e01c80f-1b58-4b6a-9e48-5a489ae3aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8e4742-eec1-462b-a7a2-f43f1b58ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8e4742-eec1-462b-a7a2-f43f1b58ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2020864547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1418736a-33ba-4fbf-945a-a39756cc78f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1551499f83c84ab69ebf486c6869cfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:42Z,use_quota=True,user_id='abd863fcadf94970bb889958ffafbb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63e13c75-3988-445d-bb52-d1b728ffc7c4),volume_type_id=63e13c75-3988-445d-bb52-d1b728ffc7c4)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef9e947-a824-45a4-82fb-287c354277ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef9e947-a824-45a4-82fb-287c354277ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d520c6ab-eca1-4d9c-903f-8fb0ac9d9176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d520c6ab-eca1-4d9c-903f-8fb0ac9d9176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1418736a-33ba-4fbf-945a-a39756cc78f1', 'volume_name': 'volume-1418736a-33ba-4fbf-945a-a39756cc78f1', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d89096-cc3a-4e87-9c1b-e7fba25bd728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d89096-cc3a-4e87-9c1b-e7fba25bd728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d20277-8db6-4e34-89fc-4337165bba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume 1418736a-33ba-4fbf-945a-a39756cc78f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1418736a-33ba-4fbf-945a-a39756cc78f1', 'volume_size': 1} Nov 06 21:23:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:42 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 1073741824" returned: 0 in 1.125s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:42 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 Nov 06 21:23:42 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:42 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782" returned: 0 in 0.420s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2020864547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1418736a-33ba-4fbf-945a-a39756cc78f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1551499f83c84ab69ebf486c6869cfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:42Z,use_quota=True,user_id='abd863fcadf94970bb889958ffafbb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63e13c75-3988-445d-bb52-d1b728ffc7c4),volume_type_id=63e13c75-3988-445d-bb52-d1b728ffc7c4)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Creating volume 1418736a-33ba-4fbf-945a-a39756cc78f1 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:42 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ab018b-0424-4882-8ec5-5096568b71b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e086dbc-16f0-4c61-93e0-00b7b96c7465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:43 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 1073741824 Nov 06 21:23:43 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:43 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 (0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782): created successfully Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e086dbc-16f0-4c61-93e0-00b7b96c7465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Flow 'volume_create_manager' (9f1d99ef-2f37-4dd5-b843-8b10f98d1ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:43 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e31fc5d2-1a08-48b1-a541-1d0d2f754d64 tempest-TestInstancesWithCinderVolumes-2145436004 None] Created volume successfully. Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Flow 'volume_create_manager' (8117ad26-2768-462f-9169-07e944fd8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e424e708-b06b-4178-8040-d9b0c831ca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e424e708-b06b-4178-8040-d9b0c831ca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-366603133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8b43f7-01fb-456f-b342-14de593fba92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1551499f83c84ab69ebf486c6869cfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:44Z,use_quota=True,user_id='abd863fcadf94970bb889958ffafbb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31211156-f4fe-4bf9-b3be-665aa02f68ca),volume_type_id=31211156-f4fe-4bf9-b3be-665aa02f68ca)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dce7beb-aed3-452f-b5a3-f08d7cb32449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dce7beb-aed3-452f-b5a3-f08d7cb32449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7065673c-b9f1-473f-ac53-ed56d2887828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:23:43 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 1073741824" returned: 0 in 0.866s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:43 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 Nov 06 21:23:44 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:44 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1" returned: 0 in 0.578s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d20277-8db6-4e34-89fc-4337165bba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1418736a-33ba-4fbf-945a-a39756cc78f1', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364c3145-280c-4b63-9b2f-f739d0b4b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:44 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume volume-1418736a-33ba-4fbf-945a-a39756cc78f1 (1418736a-33ba-4fbf-945a-a39756cc78f1): created successfully Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364c3145-280c-4b63-9b2f-f739d0b4b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Flow 'volume_create_manager' (6e01c80f-1b58-4b6a-9e48-5a489ae3aef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-25d8f9c0-b03f-43d5-8409-990ff1fb21a5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Created volume successfully. Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7065673c-b9f1-473f-ac53-ed56d2887828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b8b43f7-01fb-456f-b342-14de593fba92', 'volume_name': 'volume-4b8b43f7-01fb-456f-b342-14de593fba92', 'volume_size': 1, 'image_id': 'db849bed-b49a-416c-84f8-95230e95ca8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db849bed-b49a-416c-84f8-95230e95ca8a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1536621229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1551499f83c84ab69ebf486c6869cfa9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db849bed-b49a-416c-84f8-95230e95ca8a', 'created_at': datetime.datetime(2026, 11, 6, 20, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 23, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db849bed-b49a-416c-84f8-95230e95ca8a/file', 'properties': {}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812083c5-4275-41a5-919f-3b336ec28421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812083c5-4275-41a5-919f-3b336ec28421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192d2122-3fbe-493b-9420-ad93fb40b3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:44 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume 4b8b43f7-01fb-456f-b342-14de593fba92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b8b43f7-01fb-456f-b342-14de593fba92', 'volume_size': 1, 'image_id': 'db849bed-b49a-416c-84f8-95230e95ca8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db849bed-b49a-416c-84f8-95230e95ca8a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1536621229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1551499f83c84ab69ebf486c6869cfa9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db849bed-b49a-416c-84f8-95230e95ca8a', 'created_at': datetime.datetime(2026, 11, 6, 20, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 23, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db849bed-b49a-416c-84f8-95230e95ca8a/file', 'properties': {}}, 'image_service': } Nov 06 21:23:44 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Trying to clone 4b8b43f7-01fb-456f-b342-14de593fba92 from image db849bed-b49a-416c-84f8-95230e95ca8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/db849bed-b49a-416c-84f8-95230e95ca8a', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:23:48 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD, size 20.69 MB, duration 4.14 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:23:48 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Image download 20.69 MB at 5.00 MB/s Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db45bb57-f3c4-4b64-9e20-d1605bc82d21]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:49 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD Nov 06 21:23:49 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:49 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Temporary image db849bed-b49a-416c-84f8-95230e95ca8a is fetched for user abd863fcadf94970bb889958ffafbb8c. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daa3eb3-0799-4f53-8761-fa5d35db78f1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:49 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD Nov 06 21:23:49 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:49 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-366603133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8b43f7-01fb-456f-b342-14de593fba92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1551499f83c84ab69ebf486c6869cfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:44Z,use_quota=True,user_id='abd863fcadf94970bb889958ffafbb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31211156-f4fe-4bf9-b3be-665aa02f68ca),volume_type_id=31211156-f4fe-4bf9-b3be-665aa02f68ca)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Creating volume 4b8b43f7-01fb-456f-b342-14de593fba92 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:49 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:50 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 1073741824 Nov 06 21:23:50 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:50 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 1073741824" returned: 0 in 0.568s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:50 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 Nov 06 21:23:50 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:50 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Flow 'volume_create_manager' (4def5a6d-40ce-44fe-afca-a2e7cf085c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2657198-634b-4d85-bf49-515c563a4258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92" returned: 0 in 0.370s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2657198-634b-4d85-bf49-515c563a4258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1368793286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42a12a2-01a0-48a1-b3d9-12f1b25096d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54683b8b0c184eadb67eaa342a7e705f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:51Z,use_quota=True,user_id='68a34a17ff9344a5968513bc98c0a6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74e99385-531f-40c1-8b72-6a0fa6810257),volume_type_id=74e99385-531f-40c1-8b72-6a0fa6810257)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee343a3-edb8-430d-aea8-19a70d025cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee343a3-edb8-430d-aea8-19a70d025cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e495d-85d6-43c7-a9b5-ca8d31f62e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e495d-85d6-43c7-a9b5-ca8d31f62e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42a12a2-01a0-48a1-b3d9-12f1b25096d7', 'volume_name': 'volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce95b1f1-1c0a-48c9-a5da-cd2d2f63eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce95b1f1-1c0a-48c9-a5da-cd2d2f63eeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0c25c3-941e-4002-a9b1-49e876ac9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:51 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Volume e42a12a2-01a0-48a1-b3d9-12f1b25096d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7', 'volume_size': 1} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1368793286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42a12a2-01a0-48a1-b3d9-12f1b25096d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54683b8b0c184eadb67eaa342a7e705f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:51Z,use_quota=True,user_id='68a34a17ff9344a5968513bc98c0a6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74e99385-531f-40c1-8b72-6a0fa6810257),volume_type_id=74e99385-531f-40c1-8b72-6a0fa6810257)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Creating volume e42a12a2-01a0-48a1-b3d9-12f1b25096d7 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:51 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:51 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 1073741824 Nov 06 21:23:51 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Attempting download of db849bed-b49a-416c-84f8-95230e95ca8a ((None, [{'url': 'file:///opt/stack/data/glance/images/db849bed-b49a-416c-84f8-95230e95ca8a', 'metadata': {}}])) to volume 4b8b43f7-01fb-456f-b342-14de593fba92. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764ce37-73de-4d40-9b39-b2698624744a]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db849bed-b49a-416c-84f8-95230e95ca8a_8b_n3c8n {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:51 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db849bed-b49a-416c-84f8-95230e95ca8a_8b_n3c8n Nov 06 21:23:51 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:51 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db849bed-b49a-416c-84f8-95230e95ca8a_8b_n3c8n" returned: 0 in 0.383s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db849bed-b49a-416c-84f8-95230e95ca8a_8b_n3c8n {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:51 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 1073741824" returned: 0 in 0.557s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:51 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db849bed-b49a-416c-84f8-95230e95ca8a_8b_n3c8n Nov 06 21:23:51 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:51 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 Nov 06 21:23:51 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:51 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db849bed-b49a-416c-84f8-95230e95ca8a_8b_n3c8n" returned: 1 in 0.374s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db849bed-b49a-416c-84f8-95230e95ca8a_8b_n3c8n' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa828c9-68da-4f84-a838-b447465207c7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:51 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7" returned: 0 in 0.317s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0c25c3-941e-4002-a9b1-49e876ac9c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbbf2a9-89a3-4394-9ffb-a0207320d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:52 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Volume volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 (e42a12a2-01a0-48a1-b3d9-12f1b25096d7): created successfully Nov 06 21:23:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbbf2a9-89a3-4394-9ffb-a0207320d14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Flow 'volume_create_manager' (4def5a6d-40ce-44fe-afca-a2e7cf085c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5d0fa4df-af0e-4da6-86e0-e6ec63fc5865 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Created volume successfully. Nov 06 21:23:52 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD Nov 06 21:23:52 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:52 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:52 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] db849bed-b49a-416c-84f8-95230e95ca8a was qcow2, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:23:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:52 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 Nov 06 21:23:52 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:53 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:23:53 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:53 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.359s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:53 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f3935e44-91f9-41d5-b4d1-5b441c711f93 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Retype volume completed successfully. Nov 06 21:23:54 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92" returned: 0 in 2.428s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:54 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db849bed-b49a-416c-84f8-95230e95ca8a_jr5fi0cwdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:23:54 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Converted 112.00 MB image at 46.10 MB/s Nov 06 21:23:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:54 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 1G Nov 06 21:23:54 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Acquiring lock "cinder-e42a12a2-01a0-48a1-b3d9-12f1b25096d7-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "cinder-e42a12a2-01a0-48a1-b3d9-12f1b25096d7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:55 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 1G" returned: 0 in 0.434s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Downloaded image db849bed-b49a-416c-84f8-95230e95ca8a ((None, [{'url': 'file:///opt/stack/data/glance/images/db849bed-b49a-416c-84f8-95230e95ca8a', 'metadata': {}}])) to volume 4b8b43f7-01fb-456f-b342-14de593fba92 successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Temporary image db849bed-b49a-416c-84f8-95230e95ca8a for user abd863fcadf94970bb889958ffafbb8c is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Marking volume 4b8b43f7-01fb-456f-b342-14de593fba92 as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Copying metadata from image db849bed-b49a-416c-84f8-95230e95ca8a to 4b8b43f7-01fb-456f-b342-14de593fba92. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Creating volume glance metadata for volume 4b8b43f7-01fb-456f-b342-14de593fba92 backed by image db849bed-b49a-416c-84f8-95230e95ca8a with: {'image_id': 'db849bed-b49a-416c-84f8-95230e95ca8a', 'image_name': 'tempest-scenario-img--1536621229', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Acquiring lock "cinder-quobyte-e42a12a2-01a0-48a1-b3d9-12f1b25096d7" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "cinder-quobyte-e42a12a2-01a0-48a1-b3d9-12f1b25096d7" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ea124-b574-4254-91fd-ca3944409f31]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192d2122-3fbe-493b-9420-ad93fb40b3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8b43f7-01fb-456f-b342-14de593fba92', 'volume_size': 1, 'image_id': 'db849bed-b49a-416c-84f8-95230e95ca8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db849bed-b49a-416c-84f8-95230e95ca8a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1536621229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1551499f83c84ab69ebf486c6869cfa9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db849bed-b49a-416c-84f8-95230e95ca8a', 'created_at': datetime.datetime(2026, 11, 6, 20, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 23, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db849bed-b49a-416c-84f8-95230e95ca8a/file', 'properties': {}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c9ca6b-b00a-4e5c-90bc-276121602b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:55 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Volume volume-4b8b43f7-01fb-456f-b342-14de593fba92 (4b8b43f7-01fb-456f-b342-14de593fba92): created successfully Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c9ca6b-b00a-4e5c-90bc-276121602b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Flow 'volume_create_manager' (8117ad26-2768-462f-9169-07e944fd8074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:55 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 Nov 06 21:23:55 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:55 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6aeb9ce2-b753-4222-9efd-d30cf8cf3990 tempest-TestInstancesWithCinderVolumes-2145436004 None] Created volume successfully. Nov 06 21:23:55 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7" returned: 0 in 0.457s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:55 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7 Nov 06 21:23:55 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:56 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e42a12a2-01a0-48a1-b3d9-12f1b25096d7" returned: 0 in 0.275s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "cinder-quobyte-e42a12a2-01a0-48a1-b3d9-12f1b25096d7" released by "delete_volume" :: held 0.815s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:56 devstack cinder-volume[87450]: WARNING cinder.quota [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:56 devstack cinder-volume[87450]: WARNING cinder.quota [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Created reservations ['37a6d968-c7b1-41de-8de2-ed5ade3b4f76', '511d51c6-494a-4b2c-943b-2af93addfca8', '66bb5a13-f950-46e3-be14-d4f6b975eed3', '4c79cae5-8c75-4175-985c-8e2c582e7f3d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:56 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:23:56 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:56 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.305s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:56 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Deleted volume successfully. Nov 06 21:23:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-44200119-fdfa-4363-9afd-9b984d58fa26 tempest-VolumeRetypeWithoutMigrationTest-1885461502 None] Lock "cinder-e42a12a2-01a0-48a1-b3d9-12f1b25096d7-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Flow 'volume_create_manager' (396d0cf7-ce86-4cd6-920c-6f95a70aa644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33be6eb9-449f-4475-bcee-b38b4826fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33be6eb9-449f-4475-bcee-b38b4826fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2130419699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753d9fc5-846f-44d2-ac05-eee7f16d4a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a60a71226149148d2fc69cdfb86ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:59Z,use_quota=True,user_id='dd873dc831d74d688159c36719cf0118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d9e596-c0f0-4f07-8e97-49b256cefedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d9e596-c0f0-4f07-8e97-49b256cefedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7ce9f7-4427-4134-a740-26d388a00710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7ce9f7-4427-4134-a740-26d388a00710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753d9fc5-846f-44d2-ac05-eee7f16d4a6f', 'volume_name': 'volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d34ae43-a5a2-4b45-9f7e-5d71901302c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d34ae43-a5a2-4b45-9f7e-5d71901302c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f245164d-f99f-4acc-af54-c857f2a813d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:59 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Volume 753d9fc5-846f-44d2-ac05-eee7f16d4a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f', 'volume_size': 1} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2130419699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753d9fc5-846f-44d2-ac05-eee7f16d4a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a60a71226149148d2fc69cdfb86ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:59Z,use_quota=True,user_id='dd873dc831d74d688159c36719cf0118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Creating volume 753d9fc5-846f-44d2-ac05-eee7f16d4a6f {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:59 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:23:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:59 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f 1073741824 Nov 06 21:23:59 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:00 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f 1073741824" returned: 0 in 0.807s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:00 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f Nov 06 21:24:00 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:00 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-e8b3d640-3517-4c5e-90af-d0afcccdad95 req-71ce6231-44fd-4212-8d3a-2614b67149b5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f" returned: 0 in 0.492s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-e8b3d640-3517-4c5e-90af-d0afcccdad95 req-71ce6231-44fd-4212-8d3a-2614b67149b5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-e8b3d640-3517-4c5e-90af-d0afcccdad95 req-71ce6231-44fd-4212-8d3a-2614b67149b5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f245164d-f99f-4acc-af54-c857f2a813d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd5b053-a011-4af2-829d-18ade08497dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Volume volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f (753d9fc5-846f-44d2-ac05-eee7f16d4a6f): created successfully Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd5b053-a011-4af2-829d-18ade08497dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Flow 'volume_create_manager' (396d0cf7-ce86-4cd6-920c-6f95a70aa644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-95889e79-7f23-4360-aaf2-1fd593465df5 tempest-AttachVolumeNegativeTest-603549752 None] Created volume successfully. Nov 06 21:24:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-e8b3d640-3517-4c5e-90af-d0afcccdad95 req-71ce6231-44fd-4212-8d3a-2614b67149b5 tempest-TestInstancesWithCinderVolumes-2145436004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-4b8b43f7-01fb-456f-b342-14de593fba92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f015e9ea-5390-41b6-a508-65ec651a86e6', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:24:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-e8b3d640-3517-4c5e-90af-d0afcccdad95 req-71ce6231-44fd-4212-8d3a-2614b67149b5 tempest-TestInstancesWithCinderVolumes-2145436004 None] attachment_update completed successfully. Nov 06 21:24:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-d6f701d5-53b2-4bf1-a8de-5f6366963ad0 req-d093a70a-9c8e-43c8-8363-f0b5aefcfb85 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-d6f701d5-53b2-4bf1-a8de-5f6366963ad0 req-d093a70a-9c8e-43c8-8363-f0b5aefcfb85 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-d6f701d5-53b2-4bf1-a8de-5f6366963ad0 req-d093a70a-9c8e-43c8-8363-f0b5aefcfb85 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-d6f701d5-53b2-4bf1-a8de-5f6366963ad0 req-d093a70a-9c8e-43c8-8363-f0b5aefcfb85 tempest-AttachVolumeNegativeTest-603549752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16e43237-ce20-49b8-80a4-196ded27bb6a', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:24:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-d6f701d5-53b2-4bf1-a8de-5f6366963ad0 req-d093a70a-9c8e-43c8-8363-f0b5aefcfb85 tempest-AttachVolumeNegativeTest-603549752 None] attachment_update completed successfully. Nov 06 21:24:06 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-7e990ca6-e2f4-4cde-bae8-2b7bd7fef57b req-ab358da1-57de-48c1-b3eb-a51f5e6d7fad tempest-AttachVolumeNegativeTest-603549752 None] Terminate volume connection completed successfully. Nov 06 21:24:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-7e990ca6-e2f4-4cde-bae8-2b7bd7fef57b req-ab358da1-57de-48c1-b3eb-a51f5e6d7fad tempest-AttachVolumeNegativeTest-603549752 None] Deleting attachment 16e43237-ce20-49b8-80a4-196ded27bb6a. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:11 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:24:11 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:11 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.554s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:24:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:24:12 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=64,cinder:INSERT=24,cinder:UPDATE=75,cinder:DELETE=4 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:24:16 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=74,cinder:INSERT=13,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:24:30 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Flow 'volume_create_manager' (5570bcc9-b9aa-4b14-a6d0-62914044cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d19f837-24d6-47e3-b51f-9ea00c8413ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d19f837-24d6-47e3-b51f-9ea00c8413ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2017806433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd648c36-0ccd-4ace-978e-9d3ad6840c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982a5a75ab074bd2a163286e03f0ff5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:31Z,use_quota=True,user_id='8cffebfd52954c64aa592528acb8d565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e4fcc2-a157-48c1-aca0-89b024e86c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e4fcc2-a157-48c1-aca0-89b024e86c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed44be58-c742-4dfb-9ba6-3127a189993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed44be58-c742-4dfb-9ba6-3127a189993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd648c36-0ccd-4ace-978e-9d3ad6840c30', 'volume_name': 'volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd9783f-37b1-4e1c-95c6-cdd372a2f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd9783f-37b1-4e1c-95c6-cdd372a2f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3ba2d8-6eed-438f-8cfa-74b774a39edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:31 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Volume bd648c36-0ccd-4ace-978e-9d3ad6840c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30', 'volume_size': 1} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2017806433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd648c36-0ccd-4ace-978e-9d3ad6840c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982a5a75ab074bd2a163286e03f0ff5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:31Z,use_quota=True,user_id='8cffebfd52954c64aa592528acb8d565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Creating volume bd648c36-0ccd-4ace-978e-9d3ad6840c30 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:31 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:24:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:31 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 1073741824 Nov 06 21:24:31 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:32 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 1073741824" returned: 0 in 0.918s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:32 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 Nov 06 21:24:32 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:32 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30" returned: 0 in 0.450s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3ba2d8-6eed-438f-8cfa-74b774a39edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d451f9-d77e-4e75-a116-21017b25dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Volume volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 (bd648c36-0ccd-4ace-978e-9d3ad6840c30): created successfully Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d451f9-d77e-4e75-a116-21017b25dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Flow 'volume_create_manager' (5570bcc9-b9aa-4b14-a6d0-62914044cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9b4be143-ed38-4b26-b59a-7cb1c09b01b0 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Created volume successfully. Nov 06 21:24:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Acquiring lock "cinder-bd648c36-0ccd-4ace-978e-9d3ad6840c30-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "cinder-bd648c36-0ccd-4ace-978e-9d3ad6840c30-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Acquiring lock "cinder-quobyte-bd648c36-0ccd-4ace-978e-9d3ad6840c30" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "cinder-quobyte-bd648c36-0ccd-4ace-978e-9d3ad6840c30" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:35 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b0f95-8f04-49cd-9421-7aa2a0b79729]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:35 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 Nov 06 21:24:35 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:36 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30" returned: 0 in 0.511s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:36 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30 Nov 06 21:24:36 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:36 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bd648c36-0ccd-4ace-978e-9d3ad6840c30" returned: 0 in 0.392s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "cinder-quobyte-bd648c36-0ccd-4ace-978e-9d3ad6840c30" released by "delete_volume" :: held 0.987s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Created reservations ['fd710834-be96-421a-bc73-7b8876944164', '6ec449f7-c9b3-4e34-ab9d-91e4888c1292', '6be4ad3f-73de-4b3d-97fa-57c3952dab8a', 'cc02f33c-826f-492a-905d-b7ae4dd226b0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:36 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:24:36 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:37 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.370s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:37 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Deleted volume successfully. Nov 06 21:24:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e6f6d83-a6c3-498c-bd1f-0c29beece049 tempest-VolumeQuotasNegativeTestJSON-201954821 None] Lock "cinder-bd648c36-0ccd-4ace-978e-9d3ad6840c30-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Flow 'volume_create_manager' (188bbed0-2bf7-4bf7-90d8-ab61cf052002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63ee84f-ee8b-494b-8871-c230a5552da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63ee84f-ee8b-494b-8871-c230a5552da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2115827996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2366e28-af85-48e6-ba3c-5b7e1f631dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b2fd12bc114d068e7687c473cd59ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:39Z,use_quota=True,user_id='5f468d70744c4dd0bb8b159b70efa794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c368ad-1408-458a-a2a2-e164de3d9dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c368ad-1408-458a-a2a2-e164de3d9dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77da2ef8-36d5-4954-aae9-de148b78d13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77da2ef8-36d5-4954-aae9-de148b78d13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2366e28-af85-48e6-ba3c-5b7e1f631dbc', 'volume_name': 'volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6caf2fb-6299-4466-9692-5221bdd92783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6caf2fb-6299-4466-9692-5221bdd92783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2158ca8-abb0-4a9d-a661-c7a9a4ae6737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Volume e2366e28-af85-48e6-ba3c-5b7e1f631dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc', 'volume_size': 1} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2115827996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2366e28-af85-48e6-ba3c-5b7e1f631dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b2fd12bc114d068e7687c473cd59ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:39Z,use_quota=True,user_id='5f468d70744c4dd0bb8b159b70efa794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Creating volume e2366e28-af85-48e6-ba3c-5b7e1f631dbc {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:39 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:39 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc 1073741824 Nov 06 21:24:39 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:39 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc 1073741824" returned: 0 in 0.687s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:40 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc Nov 06 21:24:40 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:40 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc" returned: 0 in 0.362s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2158ca8-abb0-4a9d-a661-c7a9a4ae6737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31c33a5-a963-4947-b37a-1ea182790e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Volume volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc (e2366e28-af85-48e6-ba3c-5b7e1f631dbc): created successfully Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31c33a5-a963-4947-b37a-1ea182790e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Flow 'volume_create_manager' (188bbed0-2bf7-4bf7-90d8-ab61cf052002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c53ed903-9910-49a6-9847-f9683a6e796a tempest-VolumesTransfersV357Test-750773702 None] Created volume successfully. Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-242f6b3b-c3a5-4f82-8f75-ee2857a47001 req-2faf231e-22cc-4c4d-b187-36c65ec2b430 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-242f6b3b-c3a5-4f82-8f75-ee2857a47001 req-2faf231e-22cc-4c4d-b187-36c65ec2b430 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-242f6b3b-c3a5-4f82-8f75-ee2857a47001 req-2faf231e-22cc-4c4d-b187-36c65ec2b430 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-242f6b3b-c3a5-4f82-8f75-ee2857a47001 req-2faf231e-22cc-4c4d-b187-36c65ec2b430 tempest-TestInstancesWithCinderVolumes-2145436004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd471220c-27ba-4357-90a9-a45d47f04045', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:24:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-242f6b3b-c3a5-4f82-8f75-ee2857a47001 req-2faf231e-22cc-4c4d-b187-36c65ec2b430 tempest-TestInstancesWithCinderVolumes-2145436004 None] attachment_update completed successfully. Nov 06 21:24:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1a493971-3c29-4ae8-bdf0-15ce52836af7 tempest-VolumesTransfersV357Test-2127137815 None] Transfer volume completed successfully. Nov 06 21:24:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Acquiring lock "cinder-e2366e28-af85-48e6-ba3c-5b7e1f631dbc-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-e2366e28-af85-48e6-ba3c-5b7e1f631dbc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Acquiring lock "cinder-quobyte-e2366e28-af85-48e6-ba3c-5b7e1f631dbc" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-quobyte-e2366e28-af85-48e6-ba3c-5b7e1f631dbc" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfec9cd-0193-44d3-bfbc-92d23b36bc9d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:43 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc Nov 06 21:24:43 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:44 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc" returned: 0 in 0.489s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:44 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc Nov 06 21:24:44 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:44 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2366e28-af85-48e6-ba3c-5b7e1f631dbc" returned: 0 in 0.374s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-quobyte-e2366e28-af85-48e6-ba3c-5b7e1f631dbc" released by "delete_volume" :: held 0.938s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-9337faf3-ffcc-4f65-bfe0-8723aac2a1d4 req-ce52e514-b6e1-411e-8454-786b867ed320 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-9337faf3-ffcc-4f65-bfe0-8723aac2a1d4 req-ce52e514-b6e1-411e-8454-786b867ed320 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-9337faf3-ffcc-4f65-bfe0-8723aac2a1d4 req-ce52e514-b6e1-411e-8454-786b867ed320 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Created reservations ['497c3c02-526f-4726-8b2a-903728449dec', '37d1bd53-f66e-4021-b951-0a2fdc182092', '1b81d6b4-2620-404a-a2f2-871064f98a41', '372b3eb4-c1f3-4c80-b6e9-43268145db76'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-9337faf3-ffcc-4f65-bfe0-8723aac2a1d4 req-ce52e514-b6e1-411e-8454-786b867ed320 tempest-TestInstancesWithCinderVolumes-2145436004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-1418736a-33ba-4fbf-945a-a39756cc78f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cc1665a-935b-4cb5-bf02-8ae08124a6f7', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:24:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-9337faf3-ffcc-4f65-bfe0-8723aac2a1d4 req-ce52e514-b6e1-411e-8454-786b867ed320 tempest-TestInstancesWithCinderVolumes-2145436004 None] attachment_update completed successfully. Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:44 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:24:44 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:45 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.311s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:45 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Deleted volume successfully. Nov 06 21:24:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f3d687de-e6ba-4128-80b2-a67167bb5969 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-e2366e28-af85-48e6-ba3c-5b7e1f631dbc-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Flow 'volume_create_manager' (8583b8a2-307d-4f49-af49-1b89464900da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a81a17-040a-4d2e-a308-96b8dec0f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Flow 'volume_create_manager' (0c510e76-b8c8-427a-900b-8b84bb174c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0da0489-3a4a-410b-8ec3-b8a9937d9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a81a17-040a-4d2e-a308-96b8dec0f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2134904905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb00b99e-43ad-4a48-8218-77c634429d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a470c16dee4a46ba3b9bdcb86a81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:47Z,use_quota=True,user_id='e54fe93243e34f3f93e19edb117d0193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b46576a2-4292-4d12-aa3a-bbe9b581e4c2),volume_type_id=b46576a2-4292-4d12-aa3a-bbe9b581e4c2)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61384f94-b64b-46ab-9d3e-5fbefc28eb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61384f94-b64b-46ab-9d3e-5fbefc28eb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30558649-6f05-46f7-9cb4-96cf5bc5ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30558649-6f05-46f7-9cb4-96cf5bc5ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb00b99e-43ad-4a48-8218-77c634429d55', 'volume_name': 'volume-bb00b99e-43ad-4a48-8218-77c634429d55', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a079bd-346b-463f-8c2e-6c5f78b01617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a079bd-346b-463f-8c2e-6c5f78b01617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2517fd5b-2133-426f-83ee-fc4f82352de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Volume bb00b99e-43ad-4a48-8218-77c634429d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb00b99e-43ad-4a48-8218-77c634429d55', 'volume_size': 1} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2134904905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb00b99e-43ad-4a48-8218-77c634429d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a470c16dee4a46ba3b9bdcb86a81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:47Z,use_quota=True,user_id='e54fe93243e34f3f93e19edb117d0193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b46576a2-4292-4d12-aa3a-bbe9b581e4c2),volume_type_id=b46576a2-4292-4d12-aa3a-bbe9b581e4c2)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Creating volume bb00b99e-43ad-4a48-8218-77c634429d55 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:46 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0da0489-3a4a-410b-8ec3-b8a9937d9b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2048466951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26a8fe9-2df8-4876-a1ae-8f7666970637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b2fd12bc114d068e7687c473cd59ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:47Z,use_quota=True,user_id='5f468d70744c4dd0bb8b159b70efa794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817b9138-e127-4690-971c-9ca9919f2075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817b9138-e127-4690-971c-9ca9919f2075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 1073741824 Nov 06 21:24:46 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b2d5c-9442-4ace-bf7f-23f275713ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b2d5c-9442-4ace-bf7f-23f275713ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26a8fe9-2df8-4876-a1ae-8f7666970637', 'volume_name': 'volume-c26a8fe9-2df8-4876-a1ae-8f7666970637', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf28ffdd-4527-418a-9fe6-38c859667f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf28ffdd-4527-418a-9fe6-38c859667f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65856629-934b-4a29-9f0d-d2dd2a5134a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Volume c26a8fe9-2df8-4876-a1ae-8f7666970637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26a8fe9-2df8-4876-a1ae-8f7666970637', 'volume_size': 1} Nov 06 21:24:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:47 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 1073741824" returned: 0 in 0.490s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:47 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 Nov 06 21:24:47 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:47 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2048466951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26a8fe9-2df8-4876-a1ae-8f7666970637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b2fd12bc114d068e7687c473cd59ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:47Z,use_quota=True,user_id='5f468d70744c4dd0bb8b159b70efa794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Creating volume c26a8fe9-2df8-4876-a1ae-8f7666970637 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:47 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2517fd5b-2133-426f-83ee-fc4f82352de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb00b99e-43ad-4a48-8218-77c634429d55', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:47 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 1073741824 Nov 06 21:24:47 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c8d2bb-5c43-40e1-9817-be2fdaf50cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:47 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Volume volume-bb00b99e-43ad-4a48-8218-77c634429d55 (bb00b99e-43ad-4a48-8218-77c634429d55): created successfully Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c8d2bb-5c43-40e1-9817-be2fdaf50cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Flow 'volume_create_manager' (8583b8a2-307d-4f49-af49-1b89464900da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0e3c8374-0a60-4eae-a046-9fcaaf2397a1 tempest-VolumeTypesAccessTest-495753241 None] Created volume successfully. Nov 06 21:24:48 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 1073741824" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:48 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 Nov 06 21:24:48 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:48 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65856629-934b-4a29-9f0d-d2dd2a5134a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26a8fe9-2df8-4876-a1ae-8f7666970637', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e23a70b-0ae1-4720-9a26-d8587013aec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:48 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Volume volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 (c26a8fe9-2df8-4876-a1ae-8f7666970637): created successfully Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e23a70b-0ae1-4720-9a26-d8587013aec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Flow 'volume_create_manager' (0c510e76-b8c8-427a-900b-8b84bb174c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-482383ae-0b69-4fa0-bf9e-219e3e3f7422 tempest-VolumesTransfersV357Test-750773702 None] Created volume successfully. Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Acquiring lock "cinder-bb00b99e-43ad-4a48-8218-77c634429d55-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Lock "cinder-bb00b99e-43ad-4a48-8218-77c634429d55-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Acquiring lock "cinder-quobyte-bb00b99e-43ad-4a48-8218-77c634429d55" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Lock "cinder-quobyte-bb00b99e-43ad-4a48-8218-77c634429d55" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9379efd9-bfd0-47a6-a166-6b0169b22d5b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:48 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 Nov 06 21:24:48 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:49 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55" returned: 0 in 0.394s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:49 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55 Nov 06 21:24:49 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:49 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb00b99e-43ad-4a48-8218-77c634429d55" returned: 0 in 0.273s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Lock "cinder-quobyte-bb00b99e-43ad-4a48-8218-77c634429d55" released by "delete_volume" :: held 0.721s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:49 devstack cinder-volume[87450]: WARNING cinder.quota [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-321742269 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-321742269, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:24:49 devstack cinder-volume[87450]: WARNING cinder.quota [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-321742269 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-321742269, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Created reservations ['b1f8c3be-b1fe-4477-b631-0ff81250da43', 'c4dd53d9-4927-42c6-b0f2-b8699c327214', '8e8eaea3-e865-480c-83cc-63fbd0bac9a5', '20147f0e-7e3c-47ef-a49e-92a66644e174'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:49 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:24:49 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:49 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-464b6f23-0705-4fac-8de2-15309a79a899 req-682c61aa-a200-4a3d-9968-170685036b02 tempest-TestInstancesWithCinderVolumes-2145436004 None] Terminate volume connection completed successfully. Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-464b6f23-0705-4fac-8de2-15309a79a899 req-682c61aa-a200-4a3d-9968-170685036b02 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deleting attachment d471220c-27ba-4357-90a9-a45d47f04045. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:24:49 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.299s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:49 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Deleted volume successfully. Nov 06 21:24:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c256d459-8baf-4db7-bbe3-846bdbd2a19b tempest-VolumeTypesAccessTest-495753241 None] Lock "cinder-bb00b99e-43ad-4a48-8218-77c634429d55-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Acquiring lock "cinder-c26a8fe9-2df8-4876-a1ae-8f7666970637-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-c26a8fe9-2df8-4876-a1ae-8f7666970637-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Acquiring lock "cinder-quobyte-c26a8fe9-2df8-4876-a1ae-8f7666970637" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-quobyte-c26a8fe9-2df8-4876-a1ae-8f7666970637" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[127c23ba-4954-494c-87b5-185c6c47459f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:50 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 Nov 06 21:24:50 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "cinder-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "cinder-quobyte-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-quobyte-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a102dda0-53c1-4bbe-8cac-ad262c1e69e1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:50 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637" returned: 0 in 0.547s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:50 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637 Nov 06 21:24:50 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:50 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 Nov 06 21:24:50 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:51 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c26a8fe9-2df8-4876-a1ae-8f7666970637" returned: 0 in 0.414s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-quobyte-c26a8fe9-2df8-4876-a1ae-8f7666970637" released by "delete_volume" :: held 1.037s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:51 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782" returned: 0 in 0.598s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:51 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782 Nov 06 21:24:51 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Created reservations ['0fa9fd2d-1713-45f3-9fd5-0b11080464d4', 'ecfb3201-c192-4c72-bc71-f736bc8b2e0b', 'fc014652-1165-432d-9436-e6234d7c9a27', '87329dab-7118-4679-8867-97d036f55e40'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:51 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:24:51 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:51 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782" returned: 0 in 0.495s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-quobyte-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782" released by "delete_volume" :: held 1.172s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:51 devstack cinder-volume[87450]: WARNING cinder.quota [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1934580417-1644476296 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1934580417-1644476296, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:24:51 devstack cinder-volume[87450]: WARNING cinder.quota [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1934580417-1644476296 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1934580417-1644476296, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:24:51 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Created reservations ['bcd843ef-0bf0-4313-ade5-3047bf7ef0dd', '4c5e446e-3e72-480e-946d-428dfcffa623', '90058500-ef21-4f43-b6e1-a5ff4dfb27a4', '436a740a-e9d4-4590-8cde-f7db3ec49a68'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:52 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.499s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Deleted volume successfully. Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7ef94446-841d-4e71-a3ee-9b45e337ab47 tempest-VolumesTransfersV357Test-1350696704 None] Lock "cinder-c26a8fe9-2df8-4876-a1ae-8f7666970637-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:52 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:24:52 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:52 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deleted volume successfully. Nov 06 21:24:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-98882c2b-1133-41ba-acf1-1122e926b716 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-0e8bb4ad-d9be-4ad8-aa7f-39929f7ec782-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:55 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-e7e250c9-9835-4623-96bf-057416d45fa3 req-9dfae483-9f58-4fa7-8f88-0eb7b1bf8218 tempest-TestInstancesWithCinderVolumes-2145436004 None] Terminate volume connection completed successfully. Nov 06 21:24:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-e7e250c9-9835-4623-96bf-057416d45fa3 req-9dfae483-9f58-4fa7-8f88-0eb7b1bf8218 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deleting attachment 4cc1665a-935b-4cb5-bf02-8ae08124a6f7. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Flow 'volume_create_manager' (52087ef6-2b9e-49b8-a864-d0d2db13ea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a6c9c1-64cc-45fd-915e-e50288ac67cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a6c9c1-64cc-45fd-915e-e50288ac67cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-419103355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a60a71226149148d2fc69cdfb86ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:56Z,use_quota=True,user_id='dd873dc831d74d688159c36719cf0118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770bd1fc-72cd-4926-a2f4-df34130f3b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770bd1fc-72cd-4926-a2f4-df34130f3b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe7ead0-4224-4918-8087-606fa1b9c683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe7ead0-4224-4918-8087-606fa1b9c683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6', 'volume_name': 'volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79393993-2673-4afd-b353-7d1d243e4899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79393993-2673-4afd-b353-7d1d243e4899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1814b6df-e6ef-48fb-ab56-5e26e2097827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:56 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Volume cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6', 'volume_size': 1} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-419103355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a60a71226149148d2fc69cdfb86ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:56Z,use_quota=True,user_id='dd873dc831d74d688159c36719cf0118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Creating volume cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:56 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:56 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 1073741824 Nov 06 21:24:56 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "cinder-1418736a-33ba-4fbf-945a-a39756cc78f1-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-1418736a-33ba-4fbf-945a-a39756cc78f1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "cinder-quobyte-1418736a-33ba-4fbf-945a-a39756cc78f1" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-quobyte-1418736a-33ba-4fbf-945a-a39756cc78f1" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6b958-257e-488d-a47b-f7c9c82b76b5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:56 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 Nov 06 21:24:56 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:57 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 1073741824" returned: 0 in 0.760s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:57 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 Nov 06 21:24:57 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:57 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1" returned: 0 in 0.559s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:57 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1 Nov 06 21:24:57 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:57 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6" returned: 0 in 0.378s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1814b6df-e6ef-48fb-ab56-5e26e2097827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca574fc-efb0-423d-8b80-d47a9190199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:57 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Volume volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 (cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6): created successfully Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca574fc-efb0-423d-8b80-d47a9190199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Flow 'volume_create_manager' (52087ef6-2b9e-49b8-a864-d0d2db13ea39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:57 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ad408ba0-7bdf-4881-8d37-0c14fec04174 tempest-AttachVolumeNegativeTest-603549752 None] Created volume successfully. Nov 06 21:24:57 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1418736a-33ba-4fbf-945a-a39756cc78f1" returned: 0 in 0.457s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-quobyte-1418736a-33ba-4fbf-945a-a39756cc78f1" released by "delete_volume" :: held 1.104s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:57 devstack cinder-volume[87450]: WARNING cinder.quota [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979939071-268422746 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979939071-268422746, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:24:57 devstack cinder-volume[87450]: WARNING cinder.quota [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979939071-268422746 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979939071-268422746, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Created reservations ['8996e2b7-262d-4ca5-899e-edfa8bd2721f', '0054a576-e711-4938-88cf-05e5745b0f74', 'adc1beac-a480-427e-b5a6-f5b3378d8b18', 'f2ae44b5-c2ac-4157-9bb7-89c6eaa4aefb'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:57 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:24:57 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:58 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:58 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deleted volume successfully. Nov 06 21:24:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-288f164f-c3d2-467d-ae1f-8394f757c6f2 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-1418736a-33ba-4fbf-945a-a39756cc78f1-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-34dae190-f2af-4df0-8774-2065e183d529 req-aea55eb1-26da-44a4-a595-2a4868d0de07 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-34dae190-f2af-4df0-8774-2065e183d529 req-aea55eb1-26da-44a4-a595-2a4868d0de07 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-34dae190-f2af-4df0-8774-2065e183d529 req-aea55eb1-26da-44a4-a595-2a4868d0de07 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-34dae190-f2af-4df0-8774-2065e183d529 req-aea55eb1-26da-44a4-a595-2a4868d0de07 tempest-AttachVolumeNegativeTest-603549752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd383435b-e680-455f-82d6-e781e0abbac7', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:24:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-34dae190-f2af-4df0-8774-2065e183d529 req-aea55eb1-26da-44a4-a595-2a4868d0de07 tempest-AttachVolumeNegativeTest-603549752 None] attachment_update completed successfully. Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Flow 'volume_create_manager' (78caa02a-72f8-4e51-a58e-e7e6ad92b57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175279eb-dc73-4bcb-aebd-8c15a69c258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175279eb-dc73-4bcb-aebd-8c15a69c258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-414180268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89c0b61-8d96-4f41-af21-9a4d8e88c4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ac29d2e36c414c8bb4affd1c0eff9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:03Z,use_quota=True,user_id='261a5b25f8ba4a319b2cf51cd9b5368f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c582c3-c72a-4a2a-ac90-fcb081a53b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c582c3-c72a-4a2a-ac90-fcb081a53b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd539b4-1ee6-4406-9c42-b9c824a56ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd539b4-1ee6-4406-9c42-b9c824a56ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89c0b61-8d96-4f41-af21-9a4d8e88c4b7', 'volume_name': 'volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dfc46a-a138-4d19-9ce9-8035cfdeaa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dfc46a-a138-4d19-9ce9-8035cfdeaa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e3e7cf-683d-4cac-803e-5df17636d8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:02 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7', 'volume_size': 1} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-414180268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89c0b61-8d96-4f41-af21-9a4d8e88c4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ac29d2e36c414c8bb4affd1c0eff9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:03Z,use_quota=True,user_id='261a5b25f8ba4a319b2cf51cd9b5368f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Creating volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:02 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:02 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 1073741824 Nov 06 21:25:02 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:03 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 1073741824" returned: 0 in 0.718s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-f707ec52-5478-450a-bfd3-407e408a02c8 req-1514413f-7d65-447e-9ba0-ea642a09065b tempest-AttachVolumeNegativeTest-603549752 None] Terminate volume connection completed successfully. Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-f707ec52-5478-450a-bfd3-407e408a02c8 req-1514413f-7d65-447e-9ba0-ea642a09065b tempest-AttachVolumeNegativeTest-603549752 None] Deleting attachment d383435b-e680-455f-82d6-e781e0abbac7. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:03 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 Nov 06 21:25:03 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-ac93bcff-5fbc-4347-9d69-ac17db20e299 req-96f4ba8e-c562-4eb0-948f-0fbd02ae9a28 tempest-TestInstancesWithCinderVolumes-2145436004 None] Terminate volume connection completed successfully. Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-ac93bcff-5fbc-4347-9d69-ac17db20e299 req-96f4ba8e-c562-4eb0-948f-0fbd02ae9a28 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deleting attachment f015e9ea-5390-41b6-a508-65ec651a86e6. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:25:03 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" returned: 0 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e3e7cf-683d-4cac-803e-5df17636d8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f779c01a-b7e7-4ac7-adeb-cc1e0be76b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:03 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Volume volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 (f89c0b61-8d96-4f41-af21-9a4d8e88c4b7): created successfully Nov 06 21:25:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f779c01a-b7e7-4ac7-adeb-cc1e0be76b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Flow 'volume_create_manager' (78caa02a-72f8-4e51-a58e-e7e6ad92b57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-80f13589-85e9-44c8-ad10-dfdc17e76392 tempest-VolumesSnapshotListTestJSON-2094152742 None] Created volume successfully. Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Creating offline snapshot 1f9477fb-5212-48af-afbf-af2dfba007e5 of volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e32720e-5f42-414f-b69b-ee46b56309d8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "cinder-4b8b43f7-01fb-456f-b342-14de593fba92-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-4b8b43f7-01fb-456f-b342-14de593fba92-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:05 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 Nov 06 21:25:05 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "cinder-quobyte-4b8b43f7-01fb-456f-b342-14de593fba92" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-quobyte-4b8b43f7-01fb-456f-b342-14de593fba92" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c3e382-316b-479f-b3e7-7b4886ac9c45]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:05 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 Nov 06 21:25:05 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:05 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" returned: 0 in 0.485s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:05 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 1G Nov 06 21:25:05 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92" returned: 0 in 0.549s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92 Nov 06 21:25:06 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4b8b43f7-01fb-456f-b342-14de593fba92" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:06 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 1G" returned: 0 in 0.648s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-quobyte-4b8b43f7-01fb-456f-b342-14de593fba92" released by "delete_volume" :: held 0.980s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:06 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 Nov 06 21:25:06 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack cinder-volume[87450]: WARNING cinder.quota [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498318395-183632160 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498318395-183632160, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:06 devstack cinder-volume[87450]: WARNING cinder.quota [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498318395-183632160 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498318395-183632160, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Created reservations ['6acb5ecb-7d53-40be-ad7a-656b9219a25f', '50c1c936-9e71-430d-ba39-86ae526d7ee5', '19742d32-fc8b-48b4-a4ac-a651b4ee7f56', 'dcd0a473-8d44-4b80-85a0-ac1548677213'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:06 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5" returned: 0 in 0.433s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:06 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 is being set with open permissions: ugo+rw Nov 06 21:25:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 Nov 06 21:25:06 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.327s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Deleted volume successfully. Nov 06 21:25:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fa93bbd9-f75e-4280-86e4-157ee4726e63 tempest-TestInstancesWithCinderVolumes-2145436004 None] Lock "cinder-4b8b43f7-01fb-456f-b342-14de593fba92-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:07 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5" returned: 0 in 0.337s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.info Nov 06 21:25:07 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.info" returned: 0 in 0.319s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.info is being set with open permissions: ugo+rw Nov 06 21:25:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.info Nov 06 21:25:07 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:08 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.info" returned: 0 in 0.463s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9190d821-896b-4daa-8e62-d270e5732971 tempest-VolumesSnapshotListTestJSON-2094152742 None] Create snapshot completed successfully Nov 06 21:25:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Creating offline snapshot b8904bd9-772f-40f3-969d-39a07929ae4b of volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:08 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114603c-0852-4c06-be65-3daa232dfd56]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:08 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 Nov 06 21:25:08 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5" returned: 0 in 0.469s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b 1G Nov 06 21:25:09 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b 1G" returned: 0 in 0.588s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b Nov 06 21:25:09 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:10 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b" returned: 0 in 0.410s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b is being set with open permissions: ugo+rw Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:10 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b Nov 06 21:25:10 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "cinder-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "cinder-quobyte-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-quobyte-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bffded-a953-420a-a8df-41ea72d96739]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:10 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b" returned: 0 in 0.351s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:10 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 Nov 06 21:25:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-248b31c0-1feb-4c42-b052-540bd745babf tempest-VolumesSnapshotListTestJSON-2094152742 None] Create snapshot completed successfully Nov 06 21:25:10 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:10 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6" returned: 0 in 0.458s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:10 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6 Nov 06 21:25:10 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:11 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6" returned: 0 in 0.372s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-quobyte-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6" released by "delete_volume" :: held 0.912s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Created reservations ['0602f591-7917-4299-8cf7-bb05798242f8', '6e628c87-6943-4ddd-9d23-2c565f409959', 'f2765ffa-7d45-492e-ac0d-e6c8868f55cc', '5409081d-385b-43f3-abc3-f872e0a1ee2a'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:11 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.336s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:11 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "cinder-753d9fc5-846f-44d2-ac05-eee7f16d4a6f-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-753d9fc5-846f-44d2-ac05-eee7f16d4a6f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "cinder-quobyte-753d9fc5-846f-44d2-ac05-eee7f16d4a6f" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-quobyte-753d9fc5-846f-44d2-ac05-eee7f16d4a6f" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d9cd75-fffe-4648-bf4f-bcce5cba70d3]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:11 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Deleted volume successfully. Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-895cd131-da6a-4279-bfe7-5e59efe86fd2 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-cb2f99a9-63e7-4e97-9509-ae4a9c3a43a6-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:12 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f Nov 06 21:25:12 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Creating offline snapshot 14d545db-ba39-48ee-88d8-e5aa8ded13d5 of volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a902e5-197f-4112-8262-d3cfaf5743e2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:12 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b Nov 06 21:25:12 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f" returned: 0 in 0.611s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:12 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f Nov 06 21:25:12 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Flow 'volume_create_manager' (daa92968-973d-4a3d-8936-86499949b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d748eeb5-4bda-4ecb-b304-15e8dd335432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d748eeb5-4bda-4ecb-b304-15e8dd335432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1142565184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a32946f-34f6-4d49-8f49-efea499e200a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb282cd5ec453bb4cb44e0fa45e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:13Z,use_quota=True,user_id='e92a05c8118b422d85f27961dc1c1c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d34447c-9149-4545-9d8b-7ca4621d238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d34447c-9149-4545-9d8b-7ca4621d238a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdc8e13-28ab-4bf1-b5b5-c88dd231982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdc8e13-28ab-4bf1-b5b5-c88dd231982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a32946f-34f6-4d49-8f49-efea499e200a', 'volume_name': 'volume-1a32946f-34f6-4d49-8f49-efea499e200a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5df96cc-19ba-4222-a993-55c25073182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5df96cc-19ba-4222-a993-55c25073182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4390c743-bb9a-4d9c-a88c-9131fbe590e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:12 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Volume 1a32946f-34f6-4d49-8f49-efea499e200a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a32946f-34f6-4d49-8f49-efea499e200a', 'volume_size': 1} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:12 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b" returned: 0 in 0.447s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:12 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 1G Nov 06 21:25:12 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-753d9fc5-846f-44d2-ac05-eee7f16d4a6f" returned: 0 in 0.315s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-quobyte-753d9fc5-846f-44d2-ac05-eee7f16d4a6f" released by "delete_volume" :: held 1.001s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=92,cinder:UPDATE=91,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:12 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Created reservations ['a55c19f3-00c9-4801-826c-eef9c18e2276', 'd837fe91-843a-40d1-bc18-fb07fa78bf15', 'dc0b36c8-3222-4852-8af4-7ab6dee4f767', 'dc01b0a0-6495-451f-a7ee-e3cc8fa8f425'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:13 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:13 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:13 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:13 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.305s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 1G" returned: 0 in 0.570s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Deleted volume successfully. Nov 06 21:25:13 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 Nov 06 21:25:13 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e8bcccbf-5638-4ce5-8b15-798b4d752e69 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-753d9fc5-846f-44d2-ac05-eee7f16d4a6f-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:13 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5" returned: 0 in 0.314s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:13 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 is being set with open permissions: ugo+rw Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:13 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 Nov 06 21:25:13 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:13 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.710s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1142565184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a32946f-34f6-4d49-8f49-efea499e200a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb282cd5ec453bb4cb44e0fa45e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:13Z,use_quota=True,user_id='e92a05c8118b422d85f27961dc1c1c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Creating volume 1a32946f-34f6-4d49-8f49-efea499e200a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:13 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:13 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a 1073741824 Nov 06 21:25:13 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9f83bf15-8d38-4ed9-9af6-995af453c73c tempest-VolumesSnapshotListTestJSON-2094152742 None] Create snapshot completed successfully Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "cinder-161140dc-b99b-4310-985f-c875d167e614-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-161140dc-b99b-4310-985f-c875d167e614-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "cinder-quobyte-161140dc-b99b-4310-985f-c875d167e614" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-quobyte-161140dc-b99b-4310-985f-c875d167e614" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e459c0-db77-4b46-af7e-cc32ed2cbf67]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:14 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 Nov 06 21:25:14 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:14 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a 1073741824" returned: 0 in 0.754s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:14 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a Nov 06 21:25:14 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:14 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614" returned: 0 in 0.512s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614 Nov 06 21:25:15 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a" returned: 0 in 0.361s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4390c743-bb9a-4d9c-a88c-9131fbe590e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a32946f-34f6-4d49-8f49-efea499e200a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74460dbe-62d5-4eb2-afec-5b61a188b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:15 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Volume volume-1a32946f-34f6-4d49-8f49-efea499e200a (1a32946f-34f6-4d49-8f49-efea499e200a): created successfully Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74460dbe-62d5-4eb2-afec-5b61a188b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Flow 'volume_create_manager' (daa92968-973d-4a3d-8936-86499949b163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:15 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fbcfd334-1d4e-4892-a674-aeee9efcbda5 tempest-VolumesListAdminTestJSON-20040096 None] Created volume successfully. Nov 06 21:25:15 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-161140dc-b99b-4310-985f-c875d167e614" returned: 0 in 0.389s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-quobyte-161140dc-b99b-4310-985f-c875d167e614" released by "delete_volume" :: held 0.969s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Created reservations ['b96be51e-b65a-4d1b-91ab-4d65653681ab', 'a7b25060-abb7-47a0-bf78-d1688fa6e17d', '91266c2a-226e-44a4-b372-6ea2c4e04a3d', 'ff2a71a5-3cfd-41f9-9a1a-7306b9aacfa9'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-14d545db-ba39-48ee-88d8-e5aa8ded13d5-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:15 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:15 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-14d545db-ba39-48ee-88d8-e5aa8ded13d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-quobyte-14d545db-ba39-48ee-88d8-e5aa8ded13d5" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-14d545db-ba39-48ee-88d8-e5aa8ded13d5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Deleting offline snapshot 14d545db-ba39-48ee-88d8-e5aa8ded13d5 of volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] snapshot_file for this snap is: volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaef1cb-0457-4141-8fc5-62ecd46a5af9]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 Nov 06 21:25:15 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.359s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:15 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Deleted volume successfully. Nov 06 21:25:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b4ffbe4-806c-4b6b-a8da-0b398c7e5e57 tempest-AttachVolumeNegativeTest-603549752 None] Lock "cinder-161140dc-b99b-4310-985f-c875d167e614-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:16 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5" returned: 0 in 0.473s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ff0a6-e595-495c-a427-79bc4f9cff93]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:16 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b Nov 06 21:25:16 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Flow 'volume_create_manager' (0fbddf4e-d312-4b2f-ba18-8c8b8df7db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517c2e0e-9e19-4c07-9ddd-1c41421525d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517c2e0e-9e19-4c07-9ddd-1c41421525d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1689826681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5359e2e2-156a-4995-a2ba-9808b506bad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb282cd5ec453bb4cb44e0fa45e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:16Z,use_quota=True,user_id='e92a05c8118b422d85f27961dc1c1c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd958fd9-adc1-4e40-9d1b-5a1628fa899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd958fd9-adc1-4e40-9d1b-5a1628fa899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25615698-be53-4068-b8f8-6e18b98507c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25615698-be53-4068-b8f8-6e18b98507c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5359e2e2-156a-4995-a2ba-9808b506bad9', 'volume_name': 'volume-5359e2e2-156a-4995-a2ba-9808b506bad9', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f714169-3df5-4b38-be3d-f4ba8ff20a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f714169-3df5-4b38-be3d-f4ba8ff20a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af4381e-4f8d-4ea7-82a3-e9b172c12483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Volume 5359e2e2-156a-4995-a2ba-9808b506bad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5359e2e2-156a-4995-a2ba-9808b506bad9', 'volume_size': 1} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1689826681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5359e2e2-156a-4995-a2ba-9808b506bad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb282cd5ec453bb4cb44e0fa45e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:16Z,use_quota=True,user_id='e92a05c8118b422d85f27961dc1c1c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Creating volume 5359e2e2-156a-4995-a2ba-9808b506bad9 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:16 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:16 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 1073741824 Nov 06 21:25:16 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:16 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b" returned: 0 in 0.600s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:16 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 Nov 06 21:25:16 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 1073741824" returned: 0 in 0.607s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 Nov 06 21:25:17 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5" returned: 0 in 0.582s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5 Nov 06 21:25:17 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9" returned: 0 in 0.392s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af4381e-4f8d-4ea7-82a3-e9b172c12483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5359e2e2-156a-4995-a2ba-9808b506bad9', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f406ad08-389c-458e-878b-dfe3234ccb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:17 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Volume volume-5359e2e2-156a-4995-a2ba-9808b506bad9 (5359e2e2-156a-4995-a2ba-9808b506bad9): created successfully Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f406ad08-389c-458e-878b-dfe3234ccb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Flow 'volume_create_manager' (0fbddf4e-d312-4b2f-ba18-8c8b8df7db5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:17 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-363239af-06bd-43db-b0e5-456b7f93a2a1 tempest-VolumesListAdminTestJSON-20040096 None] Created volume successfully. Nov 06 21:25:17 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.14d545db-ba39-48ee-88d8-e5aa8ded13d5" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-14d545db-ba39-48ee-88d8-e5aa8ded13d5" released by "_delete_snapshot" :: held 2.153s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" released by "delete_snapshot" :: held 2.184s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Created reservations ['9747429e-d2ec-49af-88a3-25dbda70e842', 'f5f1b310-da92-44d8-bcd8-b1a1bf85a08a', '56c35d48-7d14-45cb-9fab-efda7251546a', '47e6c217-9a2e-46e9-9899-a5033b00f53b'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:17 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Delete snapshot completed successfully. Nov 06 21:25:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4670bd38-fbe9-429a-b916-07ad000c6d5f tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-14d545db-ba39-48ee-88d8-e5aa8ded13d5-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-b8904bd9-772f-40f3-969d-39a07929ae4b-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-b8904bd9-772f-40f3-969d-39a07929ae4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-quobyte-b8904bd9-772f-40f3-969d-39a07929ae4b" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-b8904bd9-772f-40f3-969d-39a07929ae4b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Deleting offline snapshot b8904bd9-772f-40f3-969d-39a07929ae4b of volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] snapshot_file for this snap is: volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[249deb85-d234-410e-afd6-55f6c0a989e2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Flow 'volume_create_manager' (b94eda04-2b5f-4229-9522-36e4a847475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:19 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b Nov 06 21:25:19 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd92627-890c-4a31-960c-9300b320e06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd92627-890c-4a31-960c-9300b320e06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1068699883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9812a016-2484-4be5-8dba-d5a9b82c3909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb282cd5ec453bb4cb44e0fa45e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:19Z,use_quota=True,user_id='e92a05c8118b422d85f27961dc1c1c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e577bf62-6816-4271-8b35-910594ac78d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e577bf62-6816-4271-8b35-910594ac78d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f3a07c-1f7d-408d-b66d-ed3ea0737cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f3a07c-1f7d-408d-b66d-ed3ea0737cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9812a016-2484-4be5-8dba-d5a9b82c3909', 'volume_name': 'volume-9812a016-2484-4be5-8dba-d5a9b82c3909', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b28f94-6763-497d-b088-c535bba10924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b28f94-6763-497d-b088-c535bba10924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15804b76-ddda-41ca-863b-a13935008ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:19 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Volume 9812a016-2484-4be5-8dba-d5a9b82c3909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9812a016-2484-4be5-8dba-d5a9b82c3909', 'volume_size': 1} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1068699883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9812a016-2484-4be5-8dba-d5a9b82c3909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb282cd5ec453bb4cb44e0fa45e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:19Z,use_quota=True,user_id='e92a05c8118b422d85f27961dc1c1c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Creating volume 9812a016-2484-4be5-8dba-d5a9b82c3909 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:19 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 1073741824 Nov 06 21:25:19 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:19 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b" returned: 0 in 0.418s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e6125-aa5f-4520-9172-a854a7fb7ff9]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 Nov 06 21:25:19 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:19 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 1073741824" returned: 0 in 0.541s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 Nov 06 21:25:19 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:20 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5" returned: 0 in 0.531s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:20 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b Nov 06 21:25:20 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:20 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909" returned: 0 in 0.457s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15804b76-ddda-41ca-863b-a13935008ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9812a016-2484-4be5-8dba-d5a9b82c3909', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccd7255-8155-4001-8ba3-a8800f84d0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:20 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Volume volume-9812a016-2484-4be5-8dba-d5a9b82c3909 (9812a016-2484-4be5-8dba-d5a9b82c3909): created successfully Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccd7255-8155-4001-8ba3-a8800f84d0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Flow 'volume_create_manager' (b94eda04-2b5f-4229-9522-36e4a847475e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-223c6264-632f-4c4f-98d2-b9e0ae620264 tempest-VolumesListAdminTestJSON-20040096 None] Created volume successfully. Nov 06 21:25:20 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b" returned: 0 in 0.537s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:20 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b Nov 06 21:25:20 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:20 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.b8904bd9-772f-40f3-969d-39a07929ae4b" returned: 0 in 0.284s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-b8904bd9-772f-40f3-969d-39a07929ae4b" released by "_delete_snapshot" :: held 1.937s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" released by "delete_snapshot" :: held 1.974s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:21 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Created reservations ['86ae9a30-3dac-498d-a64d-6893859ccd40', '91c032e8-37f6-4b3f-bacf-c5a97d3ba091', 'd2625af0-5394-4130-b46e-9e0f039af168', 'ca7c9487-4a3d-49b0-9acc-70126595e2d6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Delete snapshot completed successfully. Nov 06 21:25:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a6a32dc2-dc6c-4648-827a-b788a9e78afd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-b8904bd9-772f-40f3-969d-39a07929ae4b-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-1f9477fb-5212-48af-afbf-af2dfba007e5-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-1f9477fb-5212-48af-afbf-af2dfba007e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-quobyte-1f9477fb-5212-48af-afbf-af2dfba007e5" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-1f9477fb-5212-48af-afbf-af2dfba007e5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Deleting offline snapshot 1f9477fb-5212-48af-afbf-af2dfba007e5 of volume f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] snapshot_file for this snap is: volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c6f71-98b0-41e6-8eda-71f823cd0db5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Flow 'volume_create_manager' (b031b74d-52f2-4767-b358-b556312ebf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:22 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 Nov 06 21:25:22 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2acaf72-2c77-48d1-97ab-c35991d71519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2acaf72-2c77-48d1-97ab-c35991d71519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c843beb1-30f3-4bdc-bf6f-bd10792a766f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eab5163b664f94af1fb6cf491f8062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:22Z,use_quota=True,user_id='4a0bab9f6f4645879a1340213c47059a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af077d13-d3a6-48a2-8a0c-978e652f376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af077d13-d3a6-48a2-8a0c-978e652f376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc268fe9-61ef-45d6-8170-396fff72673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc268fe9-61ef-45d6-8170-396fff72673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c843beb1-30f3-4bdc-bf6f-bd10792a766f', 'volume_name': 'volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644ab288-dc96-4cb8-a570-019f6fbf091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644ab288-dc96-4cb8-a570-019f6fbf091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bb8cce-bc36-4847-a1f1-9bc9cdfcb637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Volume c843beb1-30f3-4bdc-bf6f-bd10792a766f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f', 'volume_size': 1} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c843beb1-30f3-4bdc-bf6f-bd10792a766f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eab5163b664f94af1fb6cf491f8062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:22Z,use_quota=True,user_id='4a0bab9f6f4645879a1340213c47059a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Creating volume c843beb1-30f3-4bdc-bf6f-bd10792a766f {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:22 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:22 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f 1073741824 Nov 06 21:25:22 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:22 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5" returned: 0 in 0.584s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0825b0eb-a041-4467-9b6f-d2ffa846ba31]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:23 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 Nov 06 21:25:23 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:23 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f 1073741824" returned: 0 in 0.671s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:23 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f Nov 06 21:25:23 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:23 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" returned: 0 in 0.569s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:23 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 Nov 06 21:25:23 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:23 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bb8cce-bc36-4847-a1f1-9bc9cdfcb637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681b79f4-1bdc-43a6-925a-579d1d06f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Volume volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f (c843beb1-30f3-4bdc-bf6f-bd10792a766f): created successfully Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681b79f4-1bdc-43a6-925a-579d1d06f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Flow 'volume_create_manager' (b031b74d-52f2-4767-b358-b556312ebf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4d5046ce-8b9a-409d-860f-562561317846 tempest-VolumesListAdminTestJSON-2135487425 None] Created volume successfully. Nov 06 21:25:24 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5" returned: 0 in 0.453s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:24 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5 Nov 06 21:25:24 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:24 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7.1f9477fb-5212-48af-afbf-af2dfba007e5" returned: 0 in 0.328s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-1f9477fb-5212-48af-afbf-af2dfba007e5" released by "_delete_snapshot" :: held 2.119s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" released by "delete_snapshot" :: held 2.150s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Created reservations ['4663a316-8e7b-4594-9e2d-6926474b9ed2', '3ac373d6-140c-49d8-9cb0-5f9a2b7b2707', '3abf2042-6d04-43a3-9efe-926a0b30725b', '5a5b98ad-9311-494b-b0db-e4773e84b11d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Delete snapshot completed successfully. Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aa6dcc26-2a26-469d-b972-3166b303fedd tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-1f9477fb-5212-48af-afbf-af2dfba007e5-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Acquiring lock "cinder-c843beb1-30f3-4bdc-bf6f-bd10792a766f-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Lock "cinder-c843beb1-30f3-4bdc-bf6f-bd10792a766f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Acquiring lock "cinder-quobyte-c843beb1-30f3-4bdc-bf6f-bd10792a766f" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Lock "cinder-quobyte-c843beb1-30f3-4bdc-bf6f-bd10792a766f" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[155212ef-1d25-411a-b577-a4ccb37246e5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "cinder-9812a016-2484-4be5-8dba-d5a9b82c3909-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-9812a016-2484-4be5-8dba-d5a9b82c3909-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "cinder-quobyte-9812a016-2484-4be5-8dba-d5a9b82c3909" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-quobyte-9812a016-2484-4be5-8dba-d5a9b82c3909" acquired by "delete_volume" :: waited 0.048s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[281124ee-6437-49c4-af07-8ad8b4c1a6b7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:25 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f Nov 06 21:25:25 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:25 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 Nov 06 21:25:25 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:25 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f" returned: 0 in 0.648s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:25 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f Nov 06 21:25:25 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:25 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909" returned: 0 in 0.556s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:25 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909 Nov 06 21:25:25 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" acquired by "delete_volume" :: waited 0.042s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fcd178-7498-4339-a2d0-32792a08e2d2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:25 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c843beb1-30f3-4bdc-bf6f-bd10792a766f" returned: 0 in 0.397s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Lock "cinder-quobyte-c843beb1-30f3-4bdc-bf6f-bd10792a766f" released by "delete_volume" :: held 1.143s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Created reservations ['29558879-840e-4a3b-85cc-d027af331ff3', '7606c947-79a0-44e6-9933-db481d3b464c', '6f78e9b8-c316-45a0-92c2-0dbb22a3041c', 'e8aa4060-8b93-45ba-854c-352828f5f645'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:26 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 Nov 06 21:25:26 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:26 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9812a016-2484-4be5-8dba-d5a9b82c3909" returned: 0 in 0.478s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-quobyte-9812a016-2484-4be5-8dba-d5a9b82c3909" released by "delete_volume" :: held 1.130s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Created reservations ['bfc3e01a-0ad4-4ba7-a7a1-ee99693a896b', '9ce7961a-aab2-4f43-b838-9f94359a4c84', '1760d5bb-796d-45af-b074-b942e9eb4a99', '85d5455a-3a5d-4492-b4b7-75575cf3cde7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:26 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:26 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:26 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:26 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:26 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" returned: 0 in 0.638s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:26 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7 Nov 06 21:25:26 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:26 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.470s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Deleted volume successfully. Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d126d2df-3a71-49ff-ad51-49861ded7b5a tempest-VolumesListAdminTestJSON-2135487425 None] Lock "cinder-c843beb1-30f3-4bdc-bf6f-bd10792a766f-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:26 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.398s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Deleted volume successfully. Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=126,cinder:UPDATE=152,cinder:INSERT=37,cinder:DELETE=14 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5b9f5d5c-d9f3-4670-8dd8-f3aba98b8ef8 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-9812a016-2484-4be5-8dba-d5a9b82c3909-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:26 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" returned: 0 in 0.407s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-quobyte-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7" released by "delete_volume" :: held 1.154s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Created reservations ['f1585428-8c5c-4ff6-80ec-1d69aff6667b', '6b69aa4b-047c-4340-b4c4-612bc7629be8', 'c6df9ee5-67a1-436d-94b2-c159aef91e7d', 'a68bdf2f-9097-4fe4-8902-ad3203d780c7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:27 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:27 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "cinder-5359e2e2-156a-4995-a2ba-9808b506bad9-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-5359e2e2-156a-4995-a2ba-9808b506bad9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "cinder-quobyte-5359e2e2-156a-4995-a2ba-9808b506bad9" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-quobyte-5359e2e2-156a-4995-a2ba-9808b506bad9" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:27 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.442s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Deleted volume successfully. Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8ae4e4-10df-4af8-b712-623d4faa56ce]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d291648a-e813-4e93-b4aa-b1e395e4013d tempest-VolumesSnapshotListTestJSON-2094152742 None] Lock "cinder-f89c0b61-8d96-4f41-af21-9a4d8e88c4b7-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:27 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 Nov 06 21:25:27 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Flow 'volume_create_manager' (84c852d5-27c2-43ea-8c8f-a7311e1382ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8091883-24b9-4cff-904d-54a375814520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8091883-24b9-4cff-904d-54a375814520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-180014189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6e1138-dfd3-4064-9d42-f39f6994d27a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d591629babc4aa09ef2aec53e244d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:28Z,use_quota=True,user_id='6a08e56c13c64dbc84cbcb68b228478a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4214ff2-b67b-4156-97e7-ae7d41d35e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4214ff2-b67b-4156-97e7-ae7d41d35e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57139a75-327c-4238-ab64-76b9b7d5dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57139a75-327c-4238-ab64-76b9b7d5dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6e1138-dfd3-4064-9d42-f39f6994d27a', 'volume_name': 'volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd4ec5d-3fe3-4859-84db-554993d2f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd4ec5d-3fe3-4859-84db-554993d2f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9172228d-e74a-455b-94b2-b673ab97198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:27 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Volume 0b6e1138-dfd3-4064-9d42-f39f6994d27a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a', 'volume_size': 1} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-180014189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6e1138-dfd3-4064-9d42-f39f6994d27a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d591629babc4aa09ef2aec53e244d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:28Z,use_quota=True,user_id='6a08e56c13c64dbc84cbcb68b228478a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Creating volume 0b6e1138-dfd3-4064-9d42-f39f6994d27a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:27 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:27 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a 1073741824 Nov 06 21:25:27 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:28 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9" returned: 0 in 0.490s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:28 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9 Nov 06 21:25:28 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:28 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5359e2e2-156a-4995-a2ba-9808b506bad9" returned: 0 in 0.375s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-quobyte-5359e2e2-156a-4995-a2ba-9808b506bad9" released by "delete_volume" :: held 0.946s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:28 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a 1073741824" returned: 0 in 0.612s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Created reservations ['6bbb9e9c-a357-48df-9497-d0d008ea401b', '95c05adc-dee3-4781-b555-9eba8736b117', 'ee100de6-2044-4143-9e8e-908503cd9f72', 'ff2c0e13-b7fb-429a-89f2-8ff3d9b5b8dd'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:28 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a Nov 06 21:25:28 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:28 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:28 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:28 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9172228d-e74a-455b-94b2-b673ab97198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09586df0-3810-4fa6-9788-bf1f5a1a1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Volume volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a (0b6e1138-dfd3-4064-9d42-f39f6994d27a): created successfully Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09586df0-3810-4fa6-9788-bf1f5a1a1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Flow 'volume_create_manager' (84c852d5-27c2-43ea-8c8f-a7311e1382ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6d726f26-4f71-4160-8de6-a4d2d241a314 tempest-VolumesTestJSON-1179966053 None] Created volume successfully. Nov 06 21:25:29 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.306s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Deleted volume successfully. Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e7fbf973-7ff3-40c8-a6de-72c2bfc06a2b tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-5359e2e2-156a-4995-a2ba-9808b506bad9-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "cinder-1a32946f-34f6-4d49-8f49-efea499e200a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-1a32946f-34f6-4d49-8f49-efea499e200a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "cinder-quobyte-1a32946f-34f6-4d49-8f49-efea499e200a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-quobyte-1a32946f-34f6-4d49-8f49-efea499e200a" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb5ed5e-6831-4dd5-90c7-4cca422320cf]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:30 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a Nov 06 21:25:30 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:30 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a" returned: 0 in 0.495s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:30 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a Nov 06 21:25:30 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:30 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1a32946f-34f6-4d49-8f49-efea499e200a" returned: 0 in 0.434s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-quobyte-1a32946f-34f6-4d49-8f49-efea499e200a" released by "delete_volume" :: held 1.008s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:30 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Created reservations ['0569c469-bc0a-4503-8440-02f1b8ca2fa9', '438cdba6-0178-4c69-80f0-d3a733076f69', '6824f8d3-04ec-46da-a621-53ff59c896b9', '88588583-823b-45f3-841e-a899e3944401'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:30 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Flow 'volume_create_manager' (be627fc5-63fe-4246-9d9f-a4b61d40b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adce317c-1205-4aa5-a42d-0b01d5a38d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adce317c-1205-4aa5-a42d-0b01d5a38d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1808909098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f08fc-6ac2-4747-8a15-b94293e99919,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d591629babc4aa09ef2aec53e244d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:31Z,use_quota=True,user_id='6a08e56c13c64dbc84cbcb68b228478a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354e57cd-0d7c-4625-b524-42776933f644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354e57cd-0d7c-4625-b524-42776933f644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03aa4c2d-31af-459e-bed7-ca908c3a7116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03aa4c2d-31af-459e-bed7-ca908c3a7116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1f08fc-6ac2-4747-8a15-b94293e99919', 'volume_name': 'volume-4e1f08fc-6ac2-4747-8a15-b94293e99919', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce5d831-1801-452c-a853-0bd23c89227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce5d831-1801-452c-a853-0bd23c89227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e4905f-ecb7-4fde-af20-8757b3f2b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Volume 4e1f08fc-6ac2-4747-8a15-b94293e99919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1f08fc-6ac2-4747-8a15-b94293e99919', 'volume_size': 1} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1808909098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f08fc-6ac2-4747-8a15-b94293e99919,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d591629babc4aa09ef2aec53e244d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:31Z,use_quota=True,user_id='6a08e56c13c64dbc84cbcb68b228478a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Creating volume 4e1f08fc-6ac2-4747-8a15-b94293e99919 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:31 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 1073741824 Nov 06 21:25:31 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:31 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:31 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Deleted volume successfully. Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b767cc5c-7ec8-4e20-9965-c2fa0256a449 tempest-VolumesListAdminTestJSON-20040096 None] Lock "cinder-1a32946f-34f6-4d49-8f49-efea499e200a-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:31 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 1073741824" returned: 0 in 0.590s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 Nov 06 21:25:31 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919" returned: 0 in 0.324s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e4905f-ecb7-4fde-af20-8757b3f2b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1f08fc-6ac2-4747-8a15-b94293e99919', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c62e08-c453-4ce4-b697-2d380f7f01da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Volume volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 (4e1f08fc-6ac2-4747-8a15-b94293e99919): created successfully Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c62e08-c453-4ce4-b697-2d380f7f01da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Flow 'volume_create_manager' (be627fc5-63fe-4246-9d9f-a4b61d40b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f9a5c968-15a2-4fe1-a680-3ef73540055c tempest-VolumesTestJSON-1179966053 None] Created volume successfully. Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (8607b645-3197-4279-a676-7570b6cc0c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33a5cd8-1deb-4c1c-af66-b54e3ff1a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33a5cd8-1deb-4c1c-af66-b54e3ff1a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-563424805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a3e132-e66a-4096-a7fc-c2217ca3d33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:32Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0bc522-a3e0-4280-90b4-39a35f1b13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0bc522-a3e0-4280-90b4-39a35f1b13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57f3247-723e-4413-9ee3-557dfa6a8c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57f3247-723e-4413-9ee3-557dfa6a8c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a3e132-e66a-4096-a7fc-c2217ca3d33d', 'volume_name': 'volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352b9507-08b0-4448-b5b2-3cbc671dd1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352b9507-08b0-4448-b5b2-3cbc671dd1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9a990c-c2c7-43d5-b9af-721a2bb3e14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Volume 73a3e132-e66a-4096-a7fc-c2217ca3d33d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d', 'volume_size': 1} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-563424805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a3e132-e66a-4096-a7fc-c2217ca3d33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:32Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Creating volume 73a3e132-e66a-4096-a7fc-c2217ca3d33d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:32 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d 1073741824 Nov 06 21:25:32 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (b7f957d1-a0b1-4e69-922d-e3d20d7a97e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f18c06-f113-4fa1-89c6-49ae10177956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f18c06-f113-4fa1-89c6-49ae10177956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690263392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c70348-b1b5-4ee5-9c66-22891dae4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:33Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192a0fef-f71b-413c-af30-69d4af259a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192a0fef-f71b-413c-af30-69d4af259a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05061f1b-ff70-42df-8710-12beaac8ef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05061f1b-ff70-42df-8710-12beaac8ef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c70348-b1b5-4ee5-9c66-22891dae4bdd', 'volume_name': 'volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48c2a93-8ca0-4543-863d-8150bfc3f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48c2a93-8ca0-4543-863d-8150bfc3f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baff2639-bb5c-4723-9824-b0161297c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Volume e7c70348-b1b5-4ee5-9c66-22891dae4bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd', 'volume_size': 1} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:33 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d 1073741824" returned: 0 in 1.006s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d Nov 06 21:25:33 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (a3aeecf6-e7b7-4723-a201-f860d27b8dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f056c7-5a7f-494e-9e20-e3f1988c8ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f056c7-5a7f-494e-9e20-e3f1988c8ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1490907973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095c5861-15f5-4e58-8db9-175fa53bb243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:34Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cef1416-c39f-4abe-9172-d8e07931e027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cef1416-c39f-4abe-9172-d8e07931e027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014fbed8-6089-41f1-8588-9e7d6ec6c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014fbed8-6089-41f1-8588-9e7d6ec6c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095c5861-15f5-4e58-8db9-175fa53bb243', 'volume_name': 'volume-095c5861-15f5-4e58-8db9-175fa53bb243', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae056735-2609-4466-9a9c-0261eb42ec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae056735-2609-4466-9a9c-0261eb42ec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0acc00-17ea-47e2-a4a5-1af2e81231a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Volume 095c5861-15f5-4e58-8db9-175fa53bb243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095c5861-15f5-4e58-8db9-175fa53bb243', 'volume_size': 1} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:34 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d" returned: 0 in 0.424s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690263392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c70348-b1b5-4ee5-9c66-22891dae4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:33Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Creating volume e7c70348-b1b5-4ee5-9c66-22891dae4bdd {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:34 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:34 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd 1073741824 Nov 06 21:25:34 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9a990c-c2c7-43d5-b9af-721a2bb3e14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0b8eaf-d59a-45f2-80b2-454455fd58e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Volume volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d (73a3e132-e66a-4096-a7fc-c2217ca3d33d): created successfully Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0b8eaf-d59a-45f2-80b2-454455fd58e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (8607b645-3197-4279-a676-7570b6cc0c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6487aa7e-788c-4270-98dd-fe2c8227381f tempest-CreateVolumesFromImageTest-953289730 None] Created volume successfully. Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Flow 'volume_create_manager' (f0587933-85c6-46b3-8dcf-23943bd8e397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28621b63-f9bc-4874-b9c1-3d86398a6033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28621b63-f9bc-4874-b9c1-3d86398a6033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1261556285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502d0d98-0286-4541-8435-dc137f599a0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d591629babc4aa09ef2aec53e244d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:35Z,use_quota=True,user_id='6a08e56c13c64dbc84cbcb68b228478a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a001122f-3541-4e39-882a-864f1b2535e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a001122f-3541-4e39-882a-864f1b2535e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c9b0e7-33f7-44b1-a3fa-3697ca5fc393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c9b0e7-33f7-44b1-a3fa-3697ca5fc393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502d0d98-0286-4541-8435-dc137f599a0c', 'volume_name': 'volume-502d0d98-0286-4541-8435-dc137f599a0c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe96515-7138-46b2-93b5-d92486a30d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe96515-7138-46b2-93b5-d92486a30d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97013e4-0df6-4308-b0c5-b3e416bb040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Volume 502d0d98-0286-4541-8435-dc137f599a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502d0d98-0286-4541-8435-dc137f599a0c', 'volume_size': 1} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:34 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (02020acb-1c1a-4f15-b5e3-079c90c62de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1817c8ca-04a3-4473-865e-384d155778bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd 1073741824" returned: 0 in 0.829s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1817c8ca-04a3-4473-865e-384d155778bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217369277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d022c65f-5666-445e-a80c-116ee68d42e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:35Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14e4310-8bcd-47fb-a6aa-167e6e2fe117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14e4310-8bcd-47fb-a6aa-167e6e2fe117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd42394-ce2a-4227-8619-6a8de38e6a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd42394-ce2a-4227-8619-6a8de38e6a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd022c65f-5666-445e-a80c-116ee68d42e9', 'volume_name': 'volume-d022c65f-5666-445e-a80c-116ee68d42e9', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1682d3-8f36-4cff-8bef-9b9287c950c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1682d3-8f36-4cff-8bef-9b9287c950c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f73b55d-9892-4e59-833a-416b609c4990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Volume d022c65f-5666-445e-a80c-116ee68d42e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d022c65f-5666-445e-a80c-116ee68d42e9', 'volume_size': 1} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:35 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd Nov 06 21:25:35 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (93988923-17ae-4ddd-aaf7-db3424f31c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f39b265-e03d-4575-843a-35d4093582be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f39b265-e03d-4575-843a-35d4093582be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003980394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c354692-6451-4df9-961f-e7c726e0c08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:35Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebf73c7-141a-4b48-9206-4db9c6b670cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebf73c7-141a-4b48-9206-4db9c6b670cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bb56f7-3ffa-4201-9b0a-f0820f85d516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bb56f7-3ffa-4201-9b0a-f0820f85d516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c354692-6451-4df9-961f-e7c726e0c08c', 'volume_name': 'volume-5c354692-6451-4df9-961f-e7c726e0c08c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a53657-ed72-4f68-a7ed-138225acaa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a53657-ed72-4f68-a7ed-138225acaa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506595b2-19ca-45c3-b7b0-1a09ffa3fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Volume 5c354692-6451-4df9-961f-e7c726e0c08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c354692-6451-4df9-961f-e7c726e0c08c', 'volume_size': 1} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:35 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd" returned: 0 in 0.436s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1490907973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095c5861-15f5-4e58-8db9-175fa53bb243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:34Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Creating volume 095c5861-15f5-4e58-8db9-175fa53bb243 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:35 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baff2639-bb5c-4723-9824-b0161297c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 1073741824 Nov 06 21:25:35 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ef06da-6894-4c72-a389-146a995a8c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Volume volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd (e7c70348-b1b5-4ee5-9c66-22891dae4bdd): created successfully Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ef06da-6894-4c72-a389-146a995a8c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (b7f957d1-a0b1-4e69-922d-e3d20d7a97e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7aaa6bef-1125-4196-9dcf-09b60fd716d7 tempest-CreateVolumesFromImageTest-953289730 None] Created volume successfully. Nov 06 21:25:36 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 1073741824" returned: 0 in 0.619s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:36 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 Nov 06 21:25:36 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:36 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243" returned: 0 in 0.329s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1261556285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502d0d98-0286-4541-8435-dc137f599a0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d591629babc4aa09ef2aec53e244d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:35Z,use_quota=True,user_id='6a08e56c13c64dbc84cbcb68b228478a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Creating volume 502d0d98-0286-4541-8435-dc137f599a0c {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:36 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:36 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c 1073741824 Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0acc00-17ea-47e2-a4a5-1af2e81231a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095c5861-15f5-4e58-8db9-175fa53bb243', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:36 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e69d0a-3b91-4be0-ad5f-a82833ca59d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Volume volume-095c5861-15f5-4e58-8db9-175fa53bb243 (095c5861-15f5-4e58-8db9-175fa53bb243): created successfully Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e69d0a-3b91-4be0-ad5f-a82833ca59d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (a3aeecf6-e7b7-4723-a201-f860d27b8dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2f3a0bd7-2824-4aff-a7aa-01e3c918dce2 tempest-CreateVolumesFromImageTest-953289730 None] Created volume successfully. Nov 06 21:25:37 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c 1073741824" returned: 0 in 0.671s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:37 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c Nov 06 21:25:37 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:37 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c" returned: 0 in 0.332s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.574s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217369277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d022c65f-5666-445e-a80c-116ee68d42e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:35Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Creating volume d022c65f-5666-445e-a80c-116ee68d42e9 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:37 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97013e4-0df6-4308-b0c5-b3e416bb040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502d0d98-0286-4541-8435-dc137f599a0c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:37 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 1073741824 Nov 06 21:25:37 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029077ea-ab6d-4cd1-8eb9-ac10273f5b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Volume volume-502d0d98-0286-4541-8435-dc137f599a0c (502d0d98-0286-4541-8435-dc137f599a0c): created successfully Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029077ea-ab6d-4cd1-8eb9-ac10273f5b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Flow 'volume_create_manager' (f0587933-85c6-46b3-8dcf-23943bd8e397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e03515a6-3ead-4066-aff2-de82d70d8465 tempest-VolumesTestJSON-1179966053 None] Created volume successfully. Nov 06 21:25:38 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 1073741824" returned: 0 in 0.635s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:38 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 Nov 06 21:25:38 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:38 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9" returned: 0 in 0.351s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.234s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003980394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c354692-6451-4df9-961f-e7c726e0c08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e97d81ba754109af5cceb93373304e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:35Z,use_quota=True,user_id='ba2c3533bf3746e9b18e7e813362893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Creating volume 5c354692-6451-4df9-961f-e7c726e0c08c {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:38 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f73b55d-9892-4e59-833a-416b609c4990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d022c65f-5666-445e-a80c-116ee68d42e9', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:38 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c 1073741824 Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1d41e1-2702-482d-a317-10f5a7ebaebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:38 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Volume volume-d022c65f-5666-445e-a80c-116ee68d42e9 (d022c65f-5666-445e-a80c-116ee68d42e9): created successfully Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1d41e1-2702-482d-a317-10f5a7ebaebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (02020acb-1c1a-4f15-b5e3-079c90c62de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-cab3aef1-5978-4767-91bb-3fb2f817163a tempest-CreateVolumesFromImageTest-953289730 None] Created volume successfully. Nov 06 21:25:39 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c 1073741824" returned: 0 in 0.719s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:39 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c Nov 06 21:25:39 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:40 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c" returned: 0 in 0.639s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506595b2-19ca-45c3-b7b0-1a09ffa3fa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c354692-6451-4df9-961f-e7c726e0c08c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb42744-5d65-4b08-979e-46fd589d9d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Acquiring lock "cinder-502d0d98-0286-4541-8435-dc137f599a0c-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Volume volume-5c354692-6451-4df9-961f-e7c726e0c08c (5c354692-6451-4df9-961f-e7c726e0c08c): created successfully Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb42744-5d65-4b08-979e-46fd589d9d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Flow 'volume_create_manager' (93988923-17ae-4ddd-aaf7-db3424f31c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Lock "cinder-502d0d98-0286-4541-8435-dc137f599a0c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b835d88f-7e2c-4887-ae54-030f95a25342 tempest-CreateVolumesFromImageTest-953289730 None] Created volume successfully. Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Acquiring lock "cinder-quobyte-502d0d98-0286-4541-8435-dc137f599a0c" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Lock "cinder-quobyte-502d0d98-0286-4541-8435-dc137f599a0c" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a3d74-6c87-4949-8314-8521cef27ac1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:40 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c Nov 06 21:25:40 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:40 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c" returned: 0 in 0.601s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:41 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c Nov 06 21:25:41 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-5c354692-6451-4df9-961f-e7c726e0c08c-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-5c354692-6451-4df9-961f-e7c726e0c08c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-quobyte-5c354692-6451-4df9-961f-e7c726e0c08c" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-5c354692-6451-4df9-961f-e7c726e0c08c" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f515c04-4f2e-443f-adc6-cd6ea2173a82]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:41 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-502d0d98-0286-4541-8435-dc137f599a0c" returned: 0 in 0.529s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Lock "cinder-quobyte-502d0d98-0286-4541-8435-dc137f599a0c" released by "delete_volume" :: held 1.217s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:41 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c Nov 06 21:25:41 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Created reservations ['0fac7ffc-5a12-471c-af6b-175945117375', 'da322382-833b-445d-8917-757bb1109c9c', 'eaf38515-5345-46a3-8967-9b379283a4f7', '92ae4dbb-5d63-4322-9989-74d1c98dd336'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:41 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:41 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:41 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c" returned: 0 in 0.557s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:42 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c Nov 06 21:25:42 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:42 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.334s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Deleted volume successfully. Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a62fa707-058d-4bac-9240-4f73add17a5b tempest-VolumesTestJSON-1179966053 None] Lock "cinder-502d0d98-0286-4541-8435-dc137f599a0c-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:42 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5c354692-6451-4df9-961f-e7c726e0c08c" returned: 0 in 0.328s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-5c354692-6451-4df9-961f-e7c726e0c08c" released by "delete_volume" :: held 0.981s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Created reservations ['5f05dd65-cda4-4584-93d5-636692af9e45', '1580b428-05e5-4e2c-9aa0-74febd79934d', '3edb9a5e-e8a2-4700-b7f3-9209d07ac392', '83cab43e-f1e7-440a-aa92-2327092b85d6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:42 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:42 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Acquiring lock "cinder-4e1f08fc-6ac2-4747-8a15-b94293e99919-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Lock "cinder-4e1f08fc-6ac2-4747-8a15-b94293e99919-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Acquiring lock "cinder-quobyte-4e1f08fc-6ac2-4747-8a15-b94293e99919" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Lock "cinder-quobyte-4e1f08fc-6ac2-4747-8a15-b94293e99919" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbbc785-63c2-451c-8196-573db7c65634]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:42 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.359s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Deleted volume successfully. Nov 06 21:25:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f0b90117-95e2-4d45-a703-e7396dd80614 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-5c354692-6451-4df9-961f-e7c726e0c08c-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:43 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 Nov 06 21:25:43 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:43 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919" returned: 0 in 0.569s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:43 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919 Nov 06 21:25:43 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-d022c65f-5666-445e-a80c-116ee68d42e9-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-d022c65f-5666-445e-a80c-116ee68d42e9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:43 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-quobyte-d022c65f-5666-445e-a80c-116ee68d42e9" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4e1f08fc-6ac2-4747-8a15-b94293e99919" returned: 0 in 0.411s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-d022c65f-5666-445e-a80c-116ee68d42e9" acquired by "delete_volume" :: waited 0.043s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Lock "cinder-quobyte-4e1f08fc-6ac2-4747-8a15-b94293e99919" released by "delete_volume" :: held 1.120s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[791e0744-e1ab-4ab2-92b7-10179fac6687]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:43 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Created reservations ['242ad183-0610-4d56-af90-63869fcf935e', '26e54bf3-5d93-43a7-9a0e-68469a68645e', '8d294513-e10b-4a6d-a266-9800eea9a815', 'cd3526b0-45b7-4700-b389-a6ed85e1a3f3'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:43 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 Nov 06 21:25:43 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:44 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:44 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:44 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9" returned: 0 in 0.455s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:44 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9 Nov 06 21:25:44 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:44 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.342s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Deleted volume successfully. Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c47e347d-2bf2-46c2-a677-0bd536ed008c tempest-VolumesTestJSON-1179966053 None] Lock "cinder-4e1f08fc-6ac2-4747-8a15-b94293e99919-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:44 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d022c65f-5666-445e-a80c-116ee68d42e9" returned: 0 in 0.348s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-d022c65f-5666-445e-a80c-116ee68d42e9" released by "delete_volume" :: held 0.870s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Created reservations ['a0582479-a85a-4156-b5c1-6173a68d18c5', '3cf9d460-168d-4570-bddc-857f717fa037', 'a4802775-42d0-4c64-82e7-bf35a454b453', 'cad9b5f4-6873-4eea-9b90-d476e7d32236'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:44 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:44 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Acquiring lock "cinder-0b6e1138-dfd3-4064-9d42-f39f6994d27a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Lock "cinder-0b6e1138-dfd3-4064-9d42-f39f6994d27a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Acquiring lock "cinder-quobyte-0b6e1138-dfd3-4064-9d42-f39f6994d27a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Lock "cinder-quobyte-0b6e1138-dfd3-4064-9d42-f39f6994d27a" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6a2d1-9647-4764-aca8-d468723050cb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:45 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Deleted volume successfully. Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f568c7d7-dacf-4198-8970-c25fa8ccd978 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-d022c65f-5666-445e-a80c-116ee68d42e9-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:45 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a Nov 06 21:25:45 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:45 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a" returned: 0 in 0.448s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:45 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a Nov 06 21:25:45 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:45 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0b6e1138-dfd3-4064-9d42-f39f6994d27a" returned: 0 in 0.296s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-095c5861-15f5-4e58-8db9-175fa53bb243-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Lock "cinder-quobyte-0b6e1138-dfd3-4064-9d42-f39f6994d27a" released by "delete_volume" :: held 0.826s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-095c5861-15f5-4e58-8db9-175fa53bb243-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Created reservations ['6886977b-3e5f-45d4-abf9-da98a39c85f0', '56426f69-ccd8-427c-9185-15abf8391565', '8d37ccce-a24d-4e3d-adc9-5cbd46a127e5', '2b2f464a-6e6c-41d4-b94d-cd465743e6ab'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-quobyte-095c5861-15f5-4e58-8db9-175fa53bb243" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-095c5861-15f5-4e58-8db9-175fa53bb243" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c25a71-b763-46c9-a441-dc319b52afcb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:46 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:46 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:46 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 Nov 06 21:25:46 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:46 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Flow 'volume_create_manager' (5d439c4f-e68b-4d49-b2e0-de036430c418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e2fb9c-fd6c-429c-960e-a91158043dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.540s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:46 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Deleted volume successfully. Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243" returned: 0 in 0.678s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e2fb9c-fd6c-429c-960e-a91158043dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1481587949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70c5bb1-e370-4aec-9354-211e13d2608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce4453eea534970b98c66492a0e8f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:47Z,use_quota=True,user_id='de214078ee0f487081613428f090043b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d98d0b-e367-4ffd-ba0c-30adc0c3aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d98d0b-e367-4ffd-ba0c-30adc0c3aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:46 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243 Nov 06 21:25:46 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921ebd3e-4e1c-4130-9f5a-07b9ca24a026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921ebd3e-4e1c-4130-9f5a-07b9ca24a026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70c5bb1-e370-4aec-9354-211e13d2608d', 'volume_name': 'volume-c70c5bb1-e370-4aec-9354-211e13d2608d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cd72a2-664d-452b-843c-3c1c16926fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cd72a2-664d-452b-843c-3c1c16926fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d777427d-47da-4796-a142-f0de6ced4e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:46 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Volume c70c5bb1-e370-4aec-9354-211e13d2608d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70c5bb1-e370-4aec-9354-211e13d2608d', 'volume_size': 1} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1481587949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70c5bb1-e370-4aec-9354-211e13d2608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce4453eea534970b98c66492a0e8f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:47Z,use_quota=True,user_id='de214078ee0f487081613428f090043b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Creating volume c70c5bb1-e370-4aec-9354-211e13d2608d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:46 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e55d789e-f028-44e2-8ade-cbe4e6fd7478 tempest-VolumesTestJSON-1179966053 None] Lock "cinder-0b6e1138-dfd3-4064-9d42-f39f6994d27a-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:46 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d 1073741824 Nov 06 21:25:46 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:47 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-095c5861-15f5-4e58-8db9-175fa53bb243" returned: 0 in 0.411s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-095c5861-15f5-4e58-8db9-175fa53bb243" released by "delete_volume" :: held 1.174s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Created reservations ['f2f88760-3c6e-4638-bb41-dec1935683d2', 'a4eeb8a9-c414-4820-8c1e-f58d868a47cc', '13f2f025-8439-4ac9-bae5-1c6f3ce98837', 'ddc2455d-b26f-4324-985b-6bdd903479e4'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:47 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:47 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:47 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d 1073741824" returned: 0 in 0.807s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:47 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.335s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Deleted volume successfully. Nov 06 21:25:47 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d Nov 06 21:25:47 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-82a3cc6a-974a-49a8-8c4a-71ee3b932977 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-095c5861-15f5-4e58-8db9-175fa53bb243-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:48 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d777427d-47da-4796-a142-f0de6ced4e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70c5bb1-e370-4aec-9354-211e13d2608d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb44112-c499-4aa5-b9ae-8a4e048b1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:48 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Volume volume-c70c5bb1-e370-4aec-9354-211e13d2608d (c70c5bb1-e370-4aec-9354-211e13d2608d): created successfully Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb44112-c499-4aa5-b9ae-8a4e048b1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Flow 'volume_create_manager' (5d439c4f-e68b-4d49-b2e0-de036430c418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-148af076-d9ca-4108-82ff-09d5039ba7ad tempest-AbsoluteLimitsTests-885141200 None] Created volume successfully. Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-e7c70348-b1b5-4ee5-9c66-22891dae4bdd-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-e7c70348-b1b5-4ee5-9c66-22891dae4bdd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-quobyte-e7c70348-b1b5-4ee5-9c66-22891dae4bdd" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-e7c70348-b1b5-4ee5-9c66-22891dae4bdd" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d2354-7c76-443f-b0b0-9f21e2e195de]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:48 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd Nov 06 21:25:48 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:48 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd" returned: 0 in 0.544s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:48 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd Nov 06 21:25:48 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:49 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e7c70348-b1b5-4ee5-9c66-22891dae4bdd" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-e7c70348-b1b5-4ee5-9c66-22891dae4bdd" released by "delete_volume" :: held 0.996s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Created reservations ['dddced9e-5636-493e-880b-4e730f0689db', '345ec849-5c3e-40d9-8f56-7ea7099d7804', '5bc5e2ba-d004-423b-8414-3219a556681f', '8a44c2ea-62e5-476d-a36b-18a072f1b5cf'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Acquiring lock "cinder-c70c5bb1-e370-4aec-9354-211e13d2608d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Lock "cinder-c70c5bb1-e370-4aec-9354-211e13d2608d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Acquiring lock "cinder-quobyte-c70c5bb1-e370-4aec-9354-211e13d2608d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:49 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:49 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Lock "cinder-quobyte-c70c5bb1-e370-4aec-9354-211e13d2608d" acquired by "delete_volume" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[291975e1-68c7-4d16-beb2-8ab412b0861c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:49 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d Nov 06 21:25:49 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:50 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.453s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Deleted volume successfully. Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-88990495-dff8-4f0c-a0e3-551011bc59c7 tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-e7c70348-b1b5-4ee5-9c66-22891dae4bdd-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:50 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d" returned: 0 in 0.597s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:50 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d Nov 06 21:25:50 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-73a3e132-e66a-4096-a7fc-c2217ca3d33d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-73a3e132-e66a-4096-a7fc-c2217ca3d33d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:50 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c70c5bb1-e370-4aec-9354-211e13d2608d" returned: 0 in 0.415s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Lock "cinder-quobyte-c70c5bb1-e370-4aec-9354-211e13d2608d" released by "delete_volume" :: held 1.127s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "cinder-quobyte-73a3e132-e66a-4096-a7fc-c2217ca3d33d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-73a3e132-e66a-4096-a7fc-c2217ca3d33d" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6488b268-4f4d-449b-a2e3-d158f3027436]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:50 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Created reservations ['9e0b114a-6828-4df9-8c45-4a071a2cd3fd', '6b9b1632-3036-4a16-a8a5-fecbd6e0b8b6', '0ec28046-5bb4-41e0-925f-254c459024ea', '1a98ac6a-5c3a-43e3-b99d-ef34886a0293'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:51 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d Nov 06 21:25:51 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:51 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:51 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:51 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.441s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Deleted volume successfully. Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ce55eae9-0ba5-4fdf-8cd7-f4757d472350 tempest-AbsoluteLimitsTests-885141200 None] Lock "cinder-c70c5bb1-e370-4aec-9354-211e13d2608d-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:51 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d" returned: 0 in 0.795s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:51 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d Nov 06 21:25:51 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:52 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-73a3e132-e66a-4096-a7fc-c2217ca3d33d" returned: 0 in 0.405s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-quobyte-73a3e132-e66a-4096-a7fc-c2217ca3d33d" released by "delete_volume" :: held 1.280s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Created reservations ['fb197156-d6e9-4342-b60d-0c96defa56e3', 'f52d673f-da3a-4561-b45a-8975340d0606', '0595bd81-8cb3-4922-84ef-2705b3cac787', '7123a9d2-a041-4265-b4a6-d3386711bcf1'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:52 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:25:52 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:52 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.291s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Deleted volume successfully. Nov 06 21:25:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0501bb1-d35e-48dd-9494-0f85b5fd23ac tempest-CreateVolumesFromImageTest-953289730 None] Lock "cinder-73a3e132-e66a-4096-a7fc-c2217ca3d33d-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (92be3f05-e997-4cda-889f-ae2d7f530160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491d8cc3-3df5-4845-bd82-4f850b228e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491d8cc3-3df5-4845-bd82-4f850b228e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591624023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3285bbd6-cc82-46c5-932c-e56c1e313d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:59Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0df7107-3fa3-4a2a-ac0c-73e9f0e3fa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0df7107-3fa3-4a2a-ac0c-73e9f0e3fa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e4562d-ddfa-46da-b8b8-d58d846e26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e4562d-ddfa-46da-b8b8-d58d846e26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3285bbd6-cc82-46c5-932c-e56c1e313d66', 'volume_name': 'volume-3285bbd6-cc82-46c5-932c-e56c1e313d66', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafcab90-0fa3-45d5-bbfb-a46dd91e098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafcab90-0fa3-45d5-bbfb-a46dd91e098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d8a8ff-8ab0-4659-bc9f-b1a5a434feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:58 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume 3285bbd6-cc82-46c5-932c-e56c1e313d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3285bbd6-cc82-46c5-932c-e56c1e313d66', 'volume_size': 1} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591624023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3285bbd6-cc82-46c5-932c-e56c1e313d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:59Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Creating volume 3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:58 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:25:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:58 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 1073741824 Nov 06 21:25:58 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:59 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 1073741824" returned: 0 in 0.762s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:59 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 Nov 06 21:25:59 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:59 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66" returned: 0 in 0.327s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d8a8ff-8ab0-4659-bc9f-b1a5a434feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3285bbd6-cc82-46c5-932c-e56c1e313d66', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3db334-e920-4f86-9ceb-41df0709a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 (3285bbd6-cc82-46c5-932c-e56c1e313d66): created successfully Nov 06 21:26:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3db334-e920-4f86-9ceb-41df0709a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (92be3f05-e997-4cda-889f-ae2d7f530160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1f6946d3-441e-4274-a0e5-70fda9312692 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created volume successfully. Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Flow 'volume_create_manager' (80a77845-63bf-4b23-af2c-108204e530cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f17432d-904e-4fb1-9597-cd97cc5fa677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f17432d-904e-4fb1-9597-cd97cc5fa677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1924745298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4b981b-d52e-44ff-800c-3cb81f252962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a687d9f58274443a512538e44fcc705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:01Z,use_quota=True,user_id='5181f4d7b0b24243a9cd8a77dffca788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59b4a00-f54c-463a-8420-9380641135c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59b4a00-f54c-463a-8420-9380641135c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828d7d85-b620-4f96-b7b0-02b55e7f071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828d7d85-b620-4f96-b7b0-02b55e7f071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4b981b-d52e-44ff-800c-3cb81f252962', 'volume_name': 'volume-5b4b981b-d52e-44ff-800c-3cb81f252962', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e57ec-9809-445b-96e3-6fed8aea058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e57ec-9809-445b-96e3-6fed8aea058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ba54b9-644b-4f0b-a801-e9a755c00b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Volume 5b4b981b-d52e-44ff-800c-3cb81f252962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4b981b-d52e-44ff-800c-3cb81f252962', 'volume_size': 1} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1924745298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4b981b-d52e-44ff-800c-3cb81f252962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a687d9f58274443a512538e44fcc705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:01Z,use_quota=True,user_id='5181f4d7b0b24243a9cd8a77dffca788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Creating volume 5b4b981b-d52e-44ff-800c-3cb81f252962 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:01 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:01 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 1073741824 Nov 06 21:26:01 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:01 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 1073741824" returned: 0 in 0.601s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:01 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 Nov 06 21:26:01 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:02 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.961s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ba54b9-644b-4f0b-a801-e9a755c00b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4b981b-d52e-44ff-800c-3cb81f252962', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8048362-8ab4-4e31-b58e-73cc2b86bbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Creating offline snapshot a152eb93-2025-4062-92ed-cbef2f48ec07 of volume 3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:26:02 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Volume volume-5b4b981b-d52e-44ff-800c-3cb81f252962 (5b4b981b-d52e-44ff-800c-3cb81f252962): created successfully Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8048362-8ab4-4e31-b58e-73cc2b86bbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Flow 'volume_create_manager' (80a77845-63bf-4b23-af2c-108204e530cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6cad75-e0c9-4c21-ba38-afcfe5453ff3]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f5c2be88-b7ff-4c35-8478-0841bf5b96d0 tempest-VolumesMetadataTest-380119491 None] Created volume successfully. Nov 06 21:26:02 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 Nov 06 21:26:02 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:02 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66" returned: 0 in 0.408s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:02 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 1G Nov 06 21:26:02 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e6394cd5-a38a-4a35-9235-decb35be56f1 tempest-GroupsTest-913863709 None] Group tempest-Group1-713540160: creating Nov 06 21:26:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e6394cd5-a38a-4a35-9235-decb35be56f1 tempest-GroupsTest-913863709 None] Group tempest-Group1-713540160: created successfully Nov 06 21:26:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e6394cd5-a38a-4a35-9235-decb35be56f1 tempest-GroupsTest-913863709 None] Create group completed successfully. Nov 06 21:26:03 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 1G" returned: 0 in 0.733s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:03 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 Nov 06 21:26:03 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:03 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07" returned: 0 in 0.456s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:03 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 is being set with open permissions: ugo+rw Nov 06 21:26:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 Nov 06 21:26:04 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07" returned: 0 in 0.316s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.info Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Acquiring lock "cinder-5b4b981b-d52e-44ff-800c-3cb81f252962-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:04 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Lock "cinder-5b4b981b-d52e-44ff-800c-3cb81f252962-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Acquiring lock "cinder-quobyte-5b4b981b-d52e-44ff-800c-3cb81f252962" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Lock "cinder-quobyte-5b4b981b-d52e-44ff-800c-3cb81f252962" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adb0452-4f06-4e1a-8f55-b3d3709174ea]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 Nov 06 21:26:04 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-62ebff9c-7f41-45f7-bad5-43af1a9ca5a7 tempest-GroupsTest-913863709 None] Group tempest-Group2-219913952: creating Nov 06 21:26:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-62ebff9c-7f41-45f7-bad5-43af1a9ca5a7 tempest-GroupsTest-913863709 None] Group tempest-Group2-219913952: created successfully Nov 06 21:26:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-62ebff9c-7f41-45f7-bad5-43af1a9ca5a7 tempest-GroupsTest-913863709 None] Create group completed successfully. Nov 06 21:26:04 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.info" returned: 0 in 0.567s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.info is being set with open permissions: ugo+rw Nov 06 21:26:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.info Nov 06 21:26:04 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:05 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962" returned: 0 in 0.584s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962 Nov 06 21:26:05 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:05 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.info" returned: 0 in 0.290s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9d85bafb-6839-4891-90c6-b2c24a8cfb93 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Create snapshot completed successfully Nov 06 21:26:05 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5b4b981b-d52e-44ff-800c-3cb81f252962" returned: 0 in 0.290s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Lock "cinder-quobyte-5b4b981b-d52e-44ff-800c-3cb81f252962" released by "delete_volume" :: held 0.954s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Created reservations ['1ebbd15a-1985-4b4f-806f-7e5d879d1d8b', '36ad423b-2280-4e20-9234-8e8b0c7ce116', 'fe28f1d0-3b55-44d1-8600-ef214a63547c', '4f489e7e-9a37-4e01-945c-efe3b4ad4087'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:05 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:05 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.327s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Deleted volume successfully. Nov 06 21:26:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-921e1784-2ef0-4787-b872-d6305319072b tempest-VolumesMetadataTest-380119491 None] Lock "cinder-5b4b981b-d52e-44ff-800c-3cb81f252962-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (6682d5b6-8471-4147-8356-59f9a3f4c4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd23a3a6-0586-4a29-bac8-bc3622e138b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd23a3a6-0586-4a29-bac8-bc3622e138b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188464578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433706ae-39e1-4aa8-9004-a8bae2e79131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:06Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fcf9c9f-7482-4f66-9235-965cebba6d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fcf9c9f-7482-4f66-9235-965cebba6d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1339a0e-6fb3-4378-8a5e-033de9fbbd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1339a0e-6fb3-4378-8a5e-033de9fbbd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433706ae-39e1-4aa8-9004-a8bae2e79131', 'volume_name': 'volume-433706ae-39e1-4aa8-9004-a8bae2e79131', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e55624-d40b-4fd0-9d4b-5148366e13d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e55624-d40b-4fd0-9d4b-5148366e13d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b010cc1-0aab-4aed-805e-cfa883fe1eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume 433706ae-39e1-4aa8-9004-a8bae2e79131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433706ae-39e1-4aa8-9004-a8bae2e79131', 'volume_size': 1} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188464578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433706ae-39e1-4aa8-9004-a8bae2e79131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:06Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Creating volume 433706ae-39e1-4aa8-9004-a8bae2e79131 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:06 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 1073741824 Nov 06 21:26:06 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Flow 'volume_create_manager' (3876d588-168a-435f-9260-8674f97ffcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361282cc-7383-4cfa-b0dd-8ac6ddb702d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361282cc-7383-4cfa-b0dd-8ac6ddb702d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001227613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29368ea9-7b5c-4e12-9351-ad4e76fc560f,host='devstack@QuobyteHD#QuobyteHD',id=bb9bbb5f-a33c-4c15-a091-457bfbf62ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5164cb49655c472c86a618dff56df20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:07Z,use_quota=True,user_id='ac93c7bf8b174e629d93fbc9d65726af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ba7b7e8-c975-43dc-b12b-376ec2081fe2),volume_type_id=4ba7b7e8-c975-43dc-b12b-376ec2081fe2)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d397582-1a84-46c6-9629-b056daf405e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d397582-1a84-46c6-9629-b056daf405e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab5f1cd-7e88-47cb-a83b-d67e47609c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab5f1cd-7e88-47cb-a83b-d67e47609c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9bbb5f-a33c-4c15-a091-457bfbf62ed3', 'volume_name': 'volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fed0102-7375-4fac-b0a9-27f6998a9009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fed0102-7375-4fac-b0a9-27f6998a9009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc791f4b-a369-492e-9492-2bfb540d52cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Volume bb9bbb5f-a33c-4c15-a091-457bfbf62ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3', 'volume_size': 1} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:07 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (638653ef-cf14-444a-9f63-0a143ca248b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fce873f-c3de-47d1-b1d3-ab3dbe03d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 1073741824" returned: 0 in 1.020s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fce873f-c3de-47d1-b1d3-ab3dbe03d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836377163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a983987-73f2-416a-8ca1-d17570d4b87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:07Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f7f01f-9800-4a06-827a-7b4a58814d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f7f01f-9800-4a06-827a-7b4a58814d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db85c4a9-067f-4976-8186-de917df61ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db85c4a9-067f-4976-8186-de917df61ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a983987-73f2-416a-8ca1-d17570d4b87f', 'volume_name': 'volume-9a983987-73f2-416a-8ca1-d17570d4b87f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4cfe86-5ac3-4fe8-b8c3-b4af1f210667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4cfe86-5ac3-4fe8-b8c3-b4af1f210667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4df2e65-16c8-42cd-8761-b757d596a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume 9a983987-73f2-416a-8ca1-d17570d4b87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a983987-73f2-416a-8ca1-d17570d4b87f', 'volume_size': 1} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:07 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 Nov 06 21:26:07 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:08 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (ddc95b5c-2c62-412f-8774-157b1dec80d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa1d0c9-3c1a-41f3-b83c-a407617540db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131" returned: 0 in 0.683s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29368ea9-7b5c-4e12-9351-ad4e76fc560f,created_at=2026-11-06T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001227613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29368ea9-7b5c-4e12-9351-ad4e76fc560f,host='devstack@QuobyteHD#QuobyteHD',id=bb9bbb5f-a33c-4c15-a091-457bfbf62ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5164cb49655c472c86a618dff56df20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:07Z,use_quota=True,user_id='ac93c7bf8b174e629d93fbc9d65726af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ba7b7e8-c975-43dc-b12b-376ec2081fe2),volume_type_id=4ba7b7e8-c975-43dc-b12b-376ec2081fe2)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Creating volume bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:08 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa1d0c9-3c1a-41f3-b83c-a407617540db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1297991351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dafe602-ce24-4299-a1ec-29bd5be3f80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:08Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:08 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 1073741824 Nov 06 21:26:08 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f60e028-3e3d-45db-ad38-6075dacb7781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f60e028-3e3d-45db-ad38-6075dacb7781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b1a467-53f3-495e-948e-a4b16d008c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b1a467-53f3-495e-948e-a4b16d008c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dafe602-ce24-4299-a1ec-29bd5be3f80f', 'volume_name': 'volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a0bdd-4dd1-4233-810b-82300fde4c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a0bdd-4dd1-4233-810b-82300fde4c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31700662-e781-4a50-8d77-fb9a4906f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:08 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume 5dafe602-ce24-4299-a1ec-29bd5be3f80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f', 'volume_size': 1} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b010cc1-0aab-4aed-805e-cfa883fe1eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433706ae-39e1-4aa8-9004-a8bae2e79131', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7221bd76-9a62-4099-95bd-1b58c8e3f0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:09 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume volume-433706ae-39e1-4aa8-9004-a8bae2e79131 (433706ae-39e1-4aa8-9004-a8bae2e79131): created successfully Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7221bd76-9a62-4099-95bd-1b58c8e3f0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (6682d5b6-8471-4147-8356-59f9a3f4c4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f24a7e48-40bc-4177-9e98-8a9f4b289309 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created volume successfully. Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (859e7b1c-64d7-40d0-8eb8-e59910769e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:09 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a102c53-c539-4b08-8fab-cccc2b6d39a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 1073741824" returned: 0 in 1.080s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a102c53-c539-4b08-8fab-cccc2b6d39a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504334070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1eb911-da35-41f0-9e7b-8f3873ffddef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:09Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefa77d-125f-41d4-b5de-3d39616f0413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefa77d-125f-41d4-b5de-3d39616f0413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d646334-a342-42ae-903b-d1fbba591bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d646334-a342-42ae-903b-d1fbba591bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1eb911-da35-41f0-9e7b-8f3873ffddef', 'volume_name': 'volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74afd3a-84fa-4b0a-b3e0-40f30f566960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74afd3a-84fa-4b0a-b3e0-40f30f566960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ce705d-5dd2-40ed-8f9a-9425d138cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:09 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume fb1eb911-da35-41f0-9e7b-8f3873ffddef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef', 'volume_size': 1} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:10 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 Nov 06 21:26:10 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (87cc8762-6aad-40c9-af30-fc063712995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efe923d-6658-4321-a02d-8e84800085b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efe923d-6658-4321-a02d-8e84800085b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131670477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9933ce84-680f-45b0-a0cc-8a36e2745254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:10Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:10 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99401d5-0575-45f2-b788-191a5c2a5614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99401d5-0575-45f2-b788-191a5c2a5614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e696b5-ca25-449d-91f0-907a87a232af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e696b5-ca25-449d-91f0-907a87a232af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9933ce84-680f-45b0-a0cc-8a36e2745254', 'volume_name': 'volume-9933ce84-680f-45b0-a0cc-8a36e2745254', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16960e49-3aa7-41f9-a5a5-ccc8963573e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16960e49-3aa7-41f9-a5a5-ccc8963573e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c016fe6-d9af-4bd9-bc4b-932026601e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:10 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume 9933ce84-680f-45b0-a0cc-8a36e2745254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9933ce84-680f-45b0-a0cc-8a36e2745254', 'volume_size': 1} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3" returned: 0 in 0.627s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836377163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a983987-73f2-416a-8ca1-d17570d4b87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:07Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Creating volume 9a983987-73f2-416a-8ca1-d17570d4b87f {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:10 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc791f4b-a369-492e-9492-2bfb540d52cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c65cd84-ae44-4711-9a35-9e33714f4945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:10 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Volume volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 (bb9bbb5f-a33c-4c15-a091-457bfbf62ed3): created successfully Nov 06 21:26:10 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f 1073741824 Nov 06 21:26:10 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c65cd84-ae44-4711-9a35-9e33714f4945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Flow 'volume_create_manager' (3876d588-168a-435f-9260-8674f97ffcb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-588fd2f0-e3f0-4b69-a1d4-888e0bd02b9a tempest-GroupsTest-913863709 None] Created volume successfully. Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:11 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:11 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:11 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f 1073741824" returned: 0 in 0.863s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:11 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f Nov 06 21:26:11 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:11 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.520s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:26:11 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.072s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1297991351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dafe602-ce24-4299-a1ec-29bd5be3f80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:08Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Creating volume 5dafe602-ce24-4299-a1ec-29bd5be3f80f {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:11 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:11 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f 1073741824 Nov 06 21:26:11 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4df2e65-16c8-42cd-8761-b757d596a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a983987-73f2-416a-8ca1-d17570d4b87f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3e8d06-ac56-48e8-b40c-56401e4b9e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:12 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume volume-9a983987-73f2-416a-8ca1-d17570d4b87f (9a983987-73f2-416a-8ca1-d17570d4b87f): created successfully Nov 06 21:26:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3e8d06-ac56-48e8-b40c-56401e4b9e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (638653ef-cf14-444a-9f63-0a143ca248b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:12 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7ed878e5-f710-411e-9e9c-9a9d4d2bda3b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created volume successfully. Nov 06 21:26:12 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f 1073741824" returned: 0 in 0.902s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:12 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:INSERT=46,cinder:UPDATE=229,cinder:SELECT=140,cinder:DELETE=15 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:26:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:12 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f Nov 06 21:26:12 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Acquiring lock "cinder-quobyte-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Lock "cinder-quobyte-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3" acquired by "delete_volume" :: waited 0.056s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:13 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb74314-63fe-4e97-ae14-7a6f589e2b17]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f" returned: 0 in 0.406s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.488s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504334070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1eb911-da35-41f0-9e7b-8f3873ffddef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:09Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Creating volume fb1eb911-da35-41f0-9e7b-8f3873ffddef {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:13 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31700662-e781-4a50-8d77-fb9a4906f61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:13 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef 1073741824 Nov 06 21:26:13 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383f3e61-a169-4fa3-bd1e-858b292dbe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:13 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f (5dafe602-ce24-4299-a1ec-29bd5be3f80f): created successfully Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383f3e61-a169-4fa3-bd1e-858b292dbe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:13 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 Nov 06 21:26:13 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (ddc95b5c-2c62-412f-8774-157b1dec80d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-917f5a16-337d-4e4e-8cd2-6a2ae210abba tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created volume successfully. Nov 06 21:26:14 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3" returned: 0 in 0.755s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:14 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3 Nov 06 21:26:14 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:14 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef 1073741824" returned: 0 in 0.968s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:14 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef Nov 06 21:26:14 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:14 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3" returned: 0 in 0.481s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Lock "cinder-quobyte-bb9bbb5f-a33c-4c15-a091-457bfbf62ed3" released by "delete_volume" :: held 1.347s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Created reservations ['e78af9fe-99ce-413e-ade9-a5af94d64446'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:14 devstack cinder-volume[87450]: WARNING cinder.quota [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2048665600 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2048665600, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:26:14 devstack cinder-volume[87450]: WARNING cinder.quota [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2048665600 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2048665600, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Created reservations ['a14d9cca-4632-44d2-980a-9ec4a238d091', '332e1a94-00e1-498d-b9cd-36dc22b9d4a4', '2883f2a0-ff11-4c16-86f6-a39b87d56668', '68405a7e-0f57-4e11-ae09-f48954073d86'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:14 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef" returned: 0 in 0.540s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.405s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131670477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9933ce84-680f-45b0-a0cc-8a36e2745254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59313eb4d774476a66cc88b0853917f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:10Z,use_quota=True,user_id='6ef5e33287e34872beca3fa65b4f3d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Creating volume 9933ce84-680f-45b0-a0cc-8a36e2745254 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:14 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:15 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 1073741824 Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ce705d-5dd2-40ed-8f9a-9425d138cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:15 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88203a30-7252-46aa-97ba-d045c938d1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:15 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef (fb1eb911-da35-41f0-9e7b-8f3873ffddef): created successfully Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88203a30-7252-46aa-97ba-d045c938d1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (859e7b1c-64d7-40d0-8eb8-e59910769e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:15 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d2db0290-02c0-4643-b319-c3919a954a79 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created volume successfully. Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:15 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:15 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:15 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:15 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4ea61436-49f7-4196-a89b-f826bb26f63c tempest-GroupsTest-913863709 None] Delete group completed successfully. Nov 06 21:26:15 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 1073741824" returned: 0 in 0.703s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:15 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 Nov 06 21:26:15 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Created reservations ['03fbb779-cadf-4646-a6c2-589c80a3653e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:16 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:16 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:16 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254" returned: 0 in 0.455s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c016fe6-d9af-4bd9-bc4b-932026601e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9933ce84-680f-45b0-a0cc-8a36e2745254', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fd4c1f-8dea-4f9a-9325-176cbc83d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Volume volume-9933ce84-680f-45b0-a0cc-8a36e2745254 (9933ce84-680f-45b0-a0cc-8a36e2745254): created successfully Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fd4c1f-8dea-4f9a-9325-176cbc83d619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Flow 'volume_create_manager' (87cc8762-6aad-40c9-af30-fc063712995a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-303eb314-f8a0-4f18-a040-13799b021eb4 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created volume successfully. Nov 06 21:26:16 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.377s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:16 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bdc265eb-ca67-4558-bf00-8355e85f164b tempest-GroupsTest-913863709 None] Delete group completed successfully. Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-9933ce84-680f-45b0-a0cc-8a36e2745254-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-9933ce84-680f-45b0-a0cc-8a36e2745254-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Flow 'volume_create_manager' (cedf915e-0b39-4de2-a575-7383cb3bc642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41634a35-25ef-457f-9ebb-17a9fd8ab74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-9933ce84-680f-45b0-a0cc-8a36e2745254" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41634a35-25ef-457f-9ebb-17a9fd8ab74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-800170998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c59f30-2643-4986-9e66-98c686b8dce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c967bd28eaf4483db44107c13c324371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:18Z,use_quota=True,user_id='b2518e5cb47543eab64f4b33284a916f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6358626-62b6-484d-97b3-9f3b64c6673c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6358626-62b6-484d-97b3-9f3b64c6673c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df7dd54-eac8-441a-8a65-950128e1efbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df7dd54-eac8-441a-8a65-950128e1efbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c59f30-2643-4986-9e66-98c686b8dce0', 'volume_name': 'volume-f1c59f30-2643-4986-9e66-98c686b8dce0', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1062effe-3c3e-4eca-859b-fb2f29c50b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1062effe-3c3e-4eca-859b-fb2f29c50b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b081596-2497-49b5-831d-adf5d3757261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Volume f1c59f30-2643-4986-9e66-98c686b8dce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c59f30-2643-4986-9e66-98c686b8dce0', 'volume_size': 1} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-800170998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c59f30-2643-4986-9e66-98c686b8dce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c967bd28eaf4483db44107c13c324371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:18Z,use_quota=True,user_id='b2518e5cb47543eab64f4b33284a916f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Creating volume f1c59f30-2643-4986-9e66-98c686b8dce0 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:17 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:17 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 1073741824 Nov 06 21:26:17 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-9933ce84-680f-45b0-a0cc-8a36e2745254" acquired by "delete_volume" :: waited 0.149s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:17 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-447bfa7e-2989-4b83-9c4c-db48a5f8cef9 tempest-GroupsTest-913863709 None] Group tempest-GroupsTest-Group-350931861: creating Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a559d5af-83b8-4897-a4cc-373b9a2cc3ee]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:17 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-447bfa7e-2989-4b83-9c4c-db48a5f8cef9 tempest-GroupsTest-913863709 None] Group tempest-GroupsTest-Group-350931861: created successfully Nov 06 21:26:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-447bfa7e-2989-4b83-9c4c-db48a5f8cef9 tempest-GroupsTest-913863709 None] Create group completed successfully. Nov 06 21:26:18 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 Nov 06 21:26:18 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:18 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 1073741824" returned: 0 in 0.497s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:18 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254" returned: 0 in 0.473s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:18 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 Nov 06 21:26:18 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:18 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254 Nov 06 21:26:18 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:18 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:18 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b081596-2497-49b5-831d-adf5d3757261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c59f30-2643-4986-9e66-98c686b8dce0', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5d477-99ac-4bc0-aa0b-ba3b1617a76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9933ce84-680f-45b0-a0cc-8a36e2745254" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-9933ce84-680f-45b0-a0cc-8a36e2745254" released by "delete_volume" :: held 0.878s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:18 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Volume volume-f1c59f30-2643-4986-9e66-98c686b8dce0 (f1c59f30-2643-4986-9e66-98c686b8dce0): created successfully Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5d477-99ac-4bc0-aa0b-ba3b1617a76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Flow 'volume_create_manager' (cedf915e-0b39-4de2-a575-7383cb3bc642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1c787d9d-5bd5-4968-88b8-85a4899b1f28 tempest-VolumesTransfersTest-1845856566 None] Created volume successfully. Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created reservations ['d5859077-2108-4503-b42a-2b1f767aaf16', '53553f10-43aa-460f-a39a-9df07b3503c5', '93b75835-b6a4-4a5f-88fa-9be96cb46e5f', '66a56777-e4c4-412c-b5f5-f88d26bc5780'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:18 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:18 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:19 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.286s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:19 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Deleted volume successfully. Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-354a92e8-601a-4071-84d7-60acd37d54f1 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-9933ce84-680f-45b0-a0cc-8a36e2745254-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Flow 'volume_create_manager' (79344fcc-cc95-4077-88ea-4d0b5e76a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ce7235-3933-42b6-bda8-9eb17e1402e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ce7235-3933-42b6-bda8-9eb17e1402e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110343764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b178068c-2fd6-4256-bcf0-7ea3d2323800,host='devstack@QuobyteHD#QuobyteHD',id=4281bf30-c25c-4e79-b54b-c27b774b3e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5164cb49655c472c86a618dff56df20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:20Z,use_quota=True,user_id='ac93c7bf8b174e629d93fbc9d65726af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe207df-20e4-4657-bff8-e6ddaef039ea),volume_type_id=dbe207df-20e4-4657-bff8-e6ddaef039ea)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab6f76a-3112-48b3-abeb-992a3997ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab6f76a-3112-48b3-abeb-992a3997ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92acf519-ec05-4dea-a645-960908584ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92acf519-ec05-4dea-a645-960908584ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4281bf30-c25c-4e79-b54b-c27b774b3e88', 'volume_name': 'volume-4281bf30-c25c-4e79-b54b-c27b774b3e88', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8383923-24fb-4972-b26d-9ba16e94feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8383923-24fb-4972-b26d-9ba16e94feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db742a1f-d5a4-4657-8b1e-d0f8c0d1223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:19 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Volume 4281bf30-c25c-4e79-b54b-c27b774b3e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4281bf30-c25c-4e79-b54b-c27b774b3e88', 'volume_size': 1} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b178068c-2fd6-4256-bcf0-7ea3d2323800,created_at=2026-11-06T20:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110343764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b178068c-2fd6-4256-bcf0-7ea3d2323800,host='devstack@QuobyteHD#QuobyteHD',id=4281bf30-c25c-4e79-b54b-c27b774b3e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5164cb49655c472c86a618dff56df20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:20Z,use_quota=True,user_id='ac93c7bf8b174e629d93fbc9d65726af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe207df-20e4-4657-bff8-e6ddaef039ea),volume_type_id=dbe207df-20e4-4657-bff8-e6ddaef039ea)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Creating volume 4281bf30-c25c-4e79-b54b-c27b774b3e88 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:19 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:19 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 1073741824 Nov 06 21:26:19 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-fb1eb911-da35-41f0-9e7b-8f3873ffddef-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-fb1eb911-da35-41f0-9e7b-8f3873ffddef-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-fb1eb911-da35-41f0-9e7b-8f3873ffddef" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-fb1eb911-da35-41f0-9e7b-8f3873ffddef" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[778c9569-a460-4d0d-a10d-e2dd6501d302]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:20 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef Nov 06 21:26:20 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:20 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 1073741824" returned: 0 in 0.641s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:20 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 Nov 06 21:26:20 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:20 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef" returned: 0 in 0.496s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:20 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef Nov 06 21:26:20 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:20 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88" returned: 0 in 0.365s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db742a1f-d5a4-4657-8b1e-d0f8c0d1223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4281bf30-c25c-4e79-b54b-c27b774b3e88', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1731d5c7-92e2-452b-b15d-0e2c187abc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:20 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Volume volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 (4281bf30-c25c-4e79-b54b-c27b774b3e88): created successfully Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1731d5c7-92e2-452b-b15d-0e2c187abc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Flow 'volume_create_manager' (79344fcc-cc95-4077-88ea-4d0b5e76a1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2ca95784-1852-494c-83bb-3a2d3b4a4985 tempest-VolumesTransfersTest-1603964551 None] Transfer volume completed successfully. Nov 06 21:26:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b8675cd5-7b7b-401d-9411-c2f994c27620 tempest-GroupsTest-913863709 None] Created volume successfully. Nov 06 21:26:21 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fb1eb911-da35-41f0-9e7b-8f3873ffddef" returned: 0 in 0.435s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-fb1eb911-da35-41f0-9e7b-8f3873ffddef" released by "delete_volume" :: held 0.986s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created reservations ['8fdf7f53-4993-43cd-91eb-dcea6892ffbd', '88cb0a20-55ae-46fb-8fb6-032ac1a6555a', '2ba15db0-f238-4d87-8cce-fcad2c1abfef', '69f91b8e-b974-4011-af6e-43c90a7ccfee'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:21 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:21 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:21 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Deleted volume successfully. Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9663f8f8-364b-454e-827f-1816a3d1063b tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-fb1eb911-da35-41f0-9e7b-8f3873ffddef-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Acquiring lock "cinder-f1c59f30-2643-4986-9e66-98c686b8dce0-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-f1c59f30-2643-4986-9e66-98c686b8dce0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Acquiring lock "cinder-quobyte-f1c59f30-2643-4986-9e66-98c686b8dce0" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-quobyte-f1c59f30-2643-4986-9e66-98c686b8dce0" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d234eb5-88bb-44dd-a870-a9d113a8fd8c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:21 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 Nov 06 21:26:21 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:22 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0" returned: 0 in 0.483s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-5dafe602-ce24-4299-a1ec-29bd5be3f80f-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:22 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0 Nov 06 21:26:22 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-5dafe602-ce24-4299-a1ec-29bd5be3f80f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-5dafe602-ce24-4299-a1ec-29bd5be3f80f" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-5dafe602-ce24-4299-a1ec-29bd5be3f80f" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[884e9689-2286-4882-b3f0-26f91c810826]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:22 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f Nov 06 21:26:22 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:22 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f1c59f30-2643-4986-9e66-98c686b8dce0" returned: 0 in 0.506s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-quobyte-f1c59f30-2643-4986-9e66-98c686b8dce0" released by "delete_volume" :: held 1.052s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Created reservations ['c1f80c53-8660-4acf-943d-e4e1776f2526', '8fbb3a4b-13ca-4f64-a61c-e01402a7b097', 'ff0a5045-1a99-49e7-9745-1b7a590775d3', '47b81786-9ca3-4fc1-8288-23071472ea29'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:22 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:22 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:22 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Flow 'volume_create_manager' (6d307cb5-5fc9-4652-a428-cd4719b09269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31925046-b3e7-4a58-973f-61ecfc19d543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f" returned: 0 in 0.532s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31925046-b3e7-4a58-973f-61ecfc19d543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890503255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b178068c-2fd6-4256-bcf0-7ea3d2323800,host='devstack@QuobyteHD#QuobyteHD',id=066e731d-53b2-4c21-81da-485a0ce0f694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5164cb49655c472c86a618dff56df20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:23Z,use_quota=True,user_id='ac93c7bf8b174e629d93fbc9d65726af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe207df-20e4-4657-bff8-e6ddaef039ea),volume_type_id=dbe207df-20e4-4657-bff8-e6ddaef039ea)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc547c7d-0f62-49ec-b163-a48695a5089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:23 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f Nov 06 21:26:23 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc547c7d-0f62-49ec-b163-a48695a5089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be4281f-484d-406a-a6d1-6f60a3f9082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be4281f-484d-406a-a6d1-6f60a3f9082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066e731d-53b2-4c21-81da-485a0ce0f694', 'volume_name': 'volume-066e731d-53b2-4c21-81da-485a0ce0f694', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a3d5f1-4f78-4fee-994c-9c7977e5d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a3d5f1-4f78-4fee-994c-9c7977e5d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f74a4b-0372-4527-9b12-a3fa05a82cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Volume 066e731d-53b2-4c21-81da-485a0ce0f694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066e731d-53b2-4c21-81da-485a0ce0f694', 'volume_size': 1} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b178068c-2fd6-4256-bcf0-7ea3d2323800,created_at=2026-11-06T20:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890503255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b178068c-2fd6-4256-bcf0-7ea3d2323800,host='devstack@QuobyteHD#QuobyteHD',id=066e731d-53b2-4c21-81da-485a0ce0f694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5164cb49655c472c86a618dff56df20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:23Z,use_quota=True,user_id='ac93c7bf8b174e629d93fbc9d65726af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe207df-20e4-4657-bff8-e6ddaef039ea),volume_type_id=dbe207df-20e4-4657-bff8-e6ddaef039ea)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Creating volume 066e731d-53b2-4c21-81da-485a0ce0f694 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:23 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 1073741824 Nov 06 21:26:23 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Deleted volume successfully. Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ac7008f0-06fa-407f-afa1-aba403d5e59b tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-f1c59f30-2643-4986-9e66-98c686b8dce0-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:23 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5dafe602-ce24-4299-a1ec-29bd5be3f80f" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-5dafe602-ce24-4299-a1ec-29bd5be3f80f" released by "delete_volume" :: held 0.886s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created reservations ['e5d8bd43-6611-46f6-8076-10032ac2459a', '0be59144-2502-4d0d-befb-2f14ef5a30ab', '1b1de2de-9802-4ac2-b60b-b74056b951bb', '39b69c42-aa1e-4949-8b0e-a817ca337418'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:23 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-9a983987-73f2-416a-8ca1-d17570d4b87f-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-9a983987-73f2-416a-8ca1-d17570d4b87f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-9a983987-73f2-416a-8ca1-d17570d4b87f" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-9a983987-73f2-416a-8ca1-d17570d4b87f" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6afe8b-8a57-47f8-876a-64374d8febaf]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 1073741824" returned: 0 in 0.551s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 Nov 06 21:26:23 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f Nov 06 21:26:23 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.304s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Deleted volume successfully. Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a380c8b4-2737-4eed-a361-e706712d4e42 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-5dafe602-ce24-4299-a1ec-29bd5be3f80f-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:23 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f74a4b-0372-4527-9b12-a3fa05a82cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066e731d-53b2-4c21-81da-485a0ce0f694', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e14900-ec3b-44c5-9f77-aaa0a8f1d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Volume volume-066e731d-53b2-4c21-81da-485a0ce0f694 (066e731d-53b2-4c21-81da-485a0ce0f694): created successfully Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e14900-ec3b-44c5-9f77-aaa0a8f1d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Flow 'volume_create_manager' (6d307cb5-5fc9-4652-a428-cd4719b09269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:24 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f" returned: 0 in 0.447s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-dfa7feea-851e-4648-9504-5dc4ea590baa tempest-GroupsTest-913863709 None] Created volume successfully. Nov 06 21:26:24 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f Nov 06 21:26:24 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:24 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9a983987-73f2-416a-8ca1-d17570d4b87f" returned: 0 in 0.281s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-9a983987-73f2-416a-8ca1-d17570d4b87f" released by "delete_volume" :: held 0.772s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created reservations ['a43b5fc6-a472-463a-a46e-ef3edabbc09f', '6ce90c3a-f0b0-4bbd-82d7-f8c175988f92', '28c7852a-9743-4873-8e1f-9b036ffc95e7', 'dbc5c0ca-c13e-4687-9ddc-be10cc84523c'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Flow 'volume_create_manager' (6f1eca4d-a613-4b40-861f-53a01faecf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c11c7-eee1-46f0-bb76-ed8ec94ce79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c11c7-eee1-46f0-bb76-ed8ec94ce79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1654396560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc23997e-4b1b-4d1e-8b2c-e36cc1145a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c967bd28eaf4483db44107c13c324371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:24Z,use_quota=True,user_id='b2518e5cb47543eab64f4b33284a916f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e381c1-4b1d-4d5c-85ff-f6e4ab628935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e381c1-4b1d-4d5c-85ff-f6e4ab628935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d40c48-2a52-4bbe-b05f-a64fb730f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d40c48-2a52-4bbe-b05f-a64fb730f031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc23997e-4b1b-4d1e-8b2c-e36cc1145a75', 'volume_name': 'volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9faec24f-c870-49d2-96af-a777bf11d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9faec24f-c870-49d2-96af-a777bf11d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9bb64-b6ff-426a-835c-73387c2ecfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Volume bc23997e-4b1b-4d1e-8b2c-e36cc1145a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75', 'volume_size': 1} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1654396560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc23997e-4b1b-4d1e-8b2c-e36cc1145a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c967bd28eaf4483db44107c13c324371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:24Z,use_quota=True,user_id='b2518e5cb47543eab64f4b33284a916f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Creating volume bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:24 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:24 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 1073741824 Nov 06 21:26:24 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:24 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:24 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-433706ae-39e1-4aa8-9004-a8bae2e79131-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-433706ae-39e1-4aa8-9004-a8bae2e79131-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-433706ae-39e1-4aa8-9004-a8bae2e79131" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-433706ae-39e1-4aa8-9004-a8bae2e79131" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4831ff91-d0c0-4275-a9c7-dfac14470d23]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:24 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Deleted volume successfully. Nov 06 21:26:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b01a9a7a-c328-4e53-ab4a-35db5aa782e2 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-9a983987-73f2-416a-8ca1-d17570d4b87f-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:24 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 Nov 06 21:26:24 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:25 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 1073741824" returned: 0 in 0.511s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 Nov 06 21:26:25 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:25 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131" returned: 0 in 0.411s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131 Nov 06 21:26:25 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d0965251-c14b-4e49-a223-be778c761422 tempest-GroupsTest-913863709 None] Update group completed successfully. Nov 06 21:26:25 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75" returned: 0 in 0.343s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9bb64-b6ff-426a-835c-73387c2ecfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820f6b7d-f79a-4aa4-ba5c-31e6780ce530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Volume volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 (bc23997e-4b1b-4d1e-8b2c-e36cc1145a75): created successfully Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820f6b7d-f79a-4aa4-ba5c-31e6780ce530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Flow 'volume_create_manager' (6f1eca4d-a613-4b40-861f-53a01faecf2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4e64eeb3-8338-4e7a-b530-8becda5405f7 tempest-VolumesTransfersTest-1845856566 None] Created volume successfully. Nov 06 21:26:25 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-433706ae-39e1-4aa8-9004-a8bae2e79131" returned: 0 in 0.292s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-433706ae-39e1-4aa8-9004-a8bae2e79131" released by "delete_volume" :: held 0.757s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created reservations ['3cfb13fa-0ed6-4d84-a309-75876b38e2ea', '98fa8aca-1792-42e6-a7e5-2d6b94e2ec8d', '429e9781-8e39-412b-ab08-2ad69a5e6151', '8ae4f476-c338-42cc-a168-878ed3343c69'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:25 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-a152eb93-2025-4062-92ed-cbef2f48ec07-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-a152eb93-2025-4062-92ed-cbef2f48ec07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-3285bbd6-cc82-46c5-932c-e56c1e313d66" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:25 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-3285bbd6-cc82-46c5-932c-e56c1e313d66" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-a152eb93-2025-4062-92ed-cbef2f48ec07" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Deleted volume successfully. Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-a152eb93-2025-4062-92ed-cbef2f48ec07" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Deleting offline snapshot a152eb93-2025-4062-92ed-cbef2f48ec07 of volume 3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] snapshot_file for this snap is: volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd74ac80-e5cb-4ba7-8d3a-d7082f73a8e8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1faaccf-df8f-42d4-8481-0df7385f2537 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-433706ae-39e1-4aa8-9004-a8bae2e79131-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:26 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 Nov 06 21:26:26 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07" returned: 0 in 0.365s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3285bbd6-cc82-46c5-932c-e56c1e313d66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad10295-be15-4ced-b104-720b215a9504]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:26 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 Nov 06 21:26:26 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fff8ce4d-03e4-4685-b65e-12a9b73ccf4a tempest-GroupsTest-913863709 None] Update group completed successfully. Nov 06 21:26:26 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66" returned: 0 in 0.483s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:26 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 Nov 06 21:26:26 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Acquiring lock "cinder-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:26 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=169,cinder:INSERT=60,cinder:UPDATE=209,cinder:DELETE=24 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Acquiring lock "cinder-quobyte-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-quobyte-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5c1193-c44b-498e-acdf-705888124f9a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:27 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 Nov 06 21:26:27 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:27 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07" returned: 0 in 0.441s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:27 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07 Nov 06 21:26:27 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:27 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75" returned: 0 in 0.439s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:27 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75 Nov 06 21:26:27 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:27 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66.a152eb93-2025-4062-92ed-cbef2f48ec07" returned: 0 in 0.287s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-a152eb93-2025-4062-92ed-cbef2f48ec07" released by "_delete_snapshot" :: held 1.700s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-3285bbd6-cc82-46c5-932c-e56c1e313d66" released by "delete_snapshot" :: held 1.733s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created reservations ['ca08761e-f0c6-4e42-84b3-4953fdfab1ef', 'ff5ecbdd-a696-4eb3-ab0f-fa88049578c7', 'e59ed88c-71c1-40d5-b0ba-9284992b0314', '0c0de732-89d1-4247-84f5-4ca5480a29d8'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Delete snapshot completed successfully. Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e349d3c1-7d6c-42f9-8d03-06a85ba10236 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-a152eb93-2025-4062-92ed-cbef2f48ec07-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:27 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75" returned: 0 in 0.304s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-quobyte-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75" released by "delete_volume" :: held 0.818s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Created reservations ['3a93e395-fcbf-4f10-af5c-892238182016', '48805b70-e6d4-41cb-9367-9d5bc93b0d68', 'dfb40732-94de-4aab-bea3-866eafb7d2f9', 'e90e2466-4f6d-4165-b015-d5ec0b635aa0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:28 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-3285bbd6-cc82-46c5-932c-e56c1e313d66-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-3285bbd6-cc82-46c5-932c-e56c1e313d66-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "cinder-quobyte-3285bbd6-cc82-46c5-932c-e56c1e313d66" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-3285bbd6-cc82-46c5-932c-e56c1e313d66" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91633ed-9929-48dd-8269-32127b0c91c2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.383s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Deleted volume successfully. Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-351e8e7e-5ede-4c4a-a315-ab2ed9c8ce8c tempest-VolumesTransfersTest-1264747903 None] Lock "cinder-bc23997e-4b1b-4d1e-8b2c-e36cc1145a75-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:28 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 Nov 06 21:26:28 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:28 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66" returned: 0 in 0.446s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66 Nov 06 21:26:28 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Acquiring lock "cinder-quobyte-066e731d-53b2-4c21-81da-485a0ce0f694" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Lock "cinder-quobyte-066e731d-53b2-4c21-81da-485a0ce0f694" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87407c6-fb73-45a8-aaa6-63c294e3904a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 Nov 06 21:26:28 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:29 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3285bbd6-cc82-46c5-932c-e56c1e313d66" returned: 0 in 0.312s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-quobyte-3285bbd6-cc82-46c5-932c-e56c1e313d66" released by "delete_volume" :: held 0.879s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Created reservations ['f973feb6-dc43-4728-8cd0-4c19b841586c', 'f20e87ba-4a77-4b2d-811a-937d077f132f', '52ed0d9a-7dcf-404f-9b78-1c3aa45e675d', 'c6b85d70-28a7-47b5-9e6f-852ba4ddd7a4'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:29 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:29 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:29 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694" returned: 0 in 0.540s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:29 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694 Nov 06 21:26:29 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:29 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.337s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Deleted volume successfully. Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f8c837c7-1eb8-4075-8037-b9463c67d9c6 tempest-CreateVolumesFromSnapshotTest-1596732008 None] Lock "cinder-3285bbd6-cc82-46c5-932c-e56c1e313d66-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:29 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-066e731d-53b2-4c21-81da-485a0ce0f694" returned: 0 in 0.383s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Lock "cinder-quobyte-066e731d-53b2-4c21-81da-485a0ce0f694" released by "delete_volume" :: held 0.990s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Acquiring lock "cinder-quobyte-4281bf30-c25c-4e79-b54b-c27b774b3e88" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Lock "cinder-quobyte-4281bf30-c25c-4e79-b54b-c27b774b3e88" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8780d4-ab25-49c5-b08b-f7bcd81bcf64]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:30 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 Nov 06 21:26:30 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:30 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88" returned: 0 in 0.583s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:30 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88 Nov 06 21:26:30 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:30 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4281bf30-c25c-4e79-b54b-c27b774b3e88" returned: 0 in 0.363s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Lock "cinder-quobyte-4281bf30-c25c-4e79-b54b-c27b774b3e88" released by "delete_volume" :: held 1.011s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Created reservations ['eb2d694c-c059-48e8-9d49-75bb39473299'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:31 devstack cinder-volume[87450]: WARNING cinder.quota [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1178102429 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1178102429, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:26:31 devstack cinder-volume[87450]: WARNING cinder.quota [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1178102429 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1178102429, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Created reservations ['0d6ee92e-3a05-42da-a083-3fe94dd922e7', '3cc6d792-25ea-4604-8821-643fa1309ae9', '6b7f2913-8922-4f91-ba7c-62550728c71d', 'ba38aed2-520a-4c08-9330-691ddc4f975c'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Created reservations ['fba35d0d-5a5a-4ec4-b62a-6889a517b221', 'caf3de3e-d1b8-4993-b0ca-e4b694e137b6', '6378a064-70dc-4dca-9f85-c2f0f70c625d', '124b989a-7e56-4abb-9e7a-3d9dc27b94a7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:31 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:31 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:31 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.343s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:31 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-cb3b8e5a-abbc-404c-b133-5c51e122d1ef tempest-GroupsTest-913863709 None] Delete group completed successfully. Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Flow 'volume_create_manager' (3a6ee6d1-afd6-453f-a9ed-d5b131ca8fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b79a82-1206-42f6-ac07-ab790c509cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b79a82-1206-42f6-ac07-ab790c509cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-124914624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d6b028-0773-4bac-876e-cfdc72eb63bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1a850f31f64200a50c0d7b4e474d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:36Z,use_quota=True,user_id='bc54db511aa7460d8c11a5089ba00acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb2f17a-a236-4738-b95a-41bbca560d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb2f17a-a236-4738-b95a-41bbca560d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dc04e2-3459-45e8-971d-ec0076ec3009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dc04e2-3459-45e8-971d-ec0076ec3009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d6b028-0773-4bac-876e-cfdc72eb63bf', 'volume_name': 'volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68b94e3-39e8-41f2-a9e3-902f4cc23711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68b94e3-39e8-41f2-a9e3-902f4cc23711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dccbe2-cc83-4287-8087-9cc711b7bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Volume a6d6b028-0773-4bac-876e-cfdc72eb63bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf', 'volume_size': 1} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-124914624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d6b028-0773-4bac-876e-cfdc72eb63bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1a850f31f64200a50c0d7b4e474d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:36Z,use_quota=True,user_id='bc54db511aa7460d8c11a5089ba00acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Creating volume a6d6b028-0773-4bac-876e-cfdc72eb63bf {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:35 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:35 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf 1073741824 Nov 06 21:26:35 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:36 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf 1073741824" returned: 0 in 0.599s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:36 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf Nov 06 21:26:36 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:36 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf" returned: 0 in 0.331s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dccbe2-cc83-4287-8087-9cc711b7bff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d1a82b-fc7a-45f9-810b-248a0df2422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Volume volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf (a6d6b028-0773-4bac-876e-cfdc72eb63bf): created successfully Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d1a82b-fc7a-45f9-810b-248a0df2422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Flow 'volume_create_manager' (3a6ee6d1-afd6-453f-a9ed-d5b131ca8fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5fca79d2-3bac-4a08-bddf-78e3726dac4e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Created volume successfully. Nov 06 21:26:37 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Flow 'volume_create_manager' (9185db54-aa21-45de-a943-f975e7d74bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4dad39-3135-4c66-bdc0-3bc1d22b035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4dad39-3135-4c66-bdc0-3bc1d22b035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8b50b8-1f17-4440-bfba-811472fa3e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03174eba01b489385c8d1c2a439005c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:38Z,use_quota=True,user_id='839526528b914c898daf6a9c4f6eb3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ac1a9a-c1e9-483f-bf55-0bb901f4cc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ac1a9a-c1e9-483f-bf55-0bb901f4cc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3f4e33-12bf-4470-9f8a-1ab28a28ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Flow 'volume_create_manager' (569e6f16-19d7-471f-833a-ee7fb49d24c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c4810a-e005-42d7-a915-f8004d4821fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c4810a-e005-42d7-a915-f8004d4821fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-441376169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b64e819d6540ce90ee56284a9d20b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:38Z,use_quota=True,user_id='060f6ea987ac447c8a0e57bf463e0a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f20b83f-bbba-40e1-bbd6-3636b45d4072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f20b83f-bbba-40e1-bbd6-3636b45d4072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c44c60-e334-4426-856f-3ae671a0518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3f4e33-12bf-4470-9f8a-1ab28a28ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c8b50b8-1f17-4440-bfba-811472fa3e95', 'volume_name': 'volume-0c8b50b8-1f17-4440-bfba-811472fa3e95', 'volume_size': 1, 'image_id': '7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0ee4263e10c7d27008b4af3a62d67d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f03174eba01b489385c8d1c2a439005c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a632863be36029a77ad831b807efc96354862f16192499cb5399326817f3abd4184af1caa121a916f4ac58d23b7adc88f478fa33dadc681f52d0f3af0e32d01', 'id': '7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'created_at': datetime.datetime(2026, 11, 6, 20, 26, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 26, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013/file', 'properties': {}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758af6b0-c7dd-4abd-a1c5-1cfc7f7431a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758af6b0-c7dd-4abd-a1c5-1cfc7f7431a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13329e89-f93c-4024-8f7d-48d986e967b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Volume 0c8b50b8-1f17-4440-bfba-811472fa3e95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c8b50b8-1f17-4440-bfba-811472fa3e95', 'volume_size': 1, 'image_id': '7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0ee4263e10c7d27008b4af3a62d67d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f03174eba01b489385c8d1c2a439005c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a632863be36029a77ad831b807efc96354862f16192499cb5399326817f3abd4184af1caa121a916f4ac58d23b7adc88f478fa33dadc681f52d0f3af0e32d01', 'id': '7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'created_at': datetime.datetime(2026, 11, 6, 20, 26, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 26, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013/file', 'properties': {}}, 'image_service': } Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Trying to clone 0c8b50b8-1f17-4440-bfba-811472fa3e95 from image 7d895d99-a7c3-4be8-9679-bd9b0e97d013 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c44c60-e334-4426-856f-3ae671a0518c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4', 'volume_name': 'volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9501af91-e28c-47fa-9551-f9a428599ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9501af91-e28c-47fa-9551-f9a428599ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacc1fc6-e955-492e-b95e-dbb113fcf246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Volume dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Trying to clone dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:26:38 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a310870a-0f83-4999-86d8-38f828cd3feb]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-efe86189-28d0-4e90-bace-47ad6d1363d9 req-2b5f688e-1453-4373-a58b-9c454673e54e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-efe86189-28d0-4e90-bace-47ad6d1363d9 req-2b5f688e-1453-4373-a58b-9c454673e54e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-efe86189-28d0-4e90-bace-47ad6d1363d9 req-2b5f688e-1453-4373-a58b-9c454673e54e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:39 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD Nov 06 21:26:39 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-efe86189-28d0-4e90-bace-47ad6d1363d9 req-2b5f688e-1453-4373-a58b-9c454673e54e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4491707-76e6-4e9d-9840-7bbf9eff8bf1', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:26:39 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:26:39 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-efe86189-28d0-4e90-bace-47ad6d1363d9 req-2b5f688e-1453-4373-a58b-9c454673e54e tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] attachment_update completed successfully. Nov 06 21:26:39 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9d4c5-d95d-4f7b-a5e8-1b5084b279ef]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:39 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD Nov 06 21:26:39 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:39 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD Nov 06 21:26:39 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:39 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 is fetched for user 060f6ea987ac447c8a0e57bf463e0a91. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:26:39 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD" returned: 1 in 0.497s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Temporary image 7d895d99-a7c3-4be8-9679-bd9b0e97d013 is fetched for user 839526528b914c898daf6a9c4f6eb3b3. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e78d97-d6b4-411b-9519-bbecaf9ba364]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff998811-d313-4c47-8205-02b36ceba407]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:40 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD Nov 06 21:26:40 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:40 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD Nov 06 21:26:40 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:40 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:40 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD" returned: 0 in 0.563s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-441376169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b64e819d6540ce90ee56284a9d20b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:38Z,use_quota=True,user_id='060f6ea987ac447c8a0e57bf463e0a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Creating volume dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:40 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:40 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 1073741824 Nov 06 21:26:40 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:40 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD Nov 06 21:26:40 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:40 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:26:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:41 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 1073741824" returned: 0 in 0.660s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:41 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 Nov 06 21:26:41 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9fb53b86-1575-4b4d-803c-ff382d3fbe7f tempest-GroupsV320Test-1171012732 None] Group tempest-GroupsV320Test-Group-471810475: creating Nov 06 21:26:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9fb53b86-1575-4b4d-803c-ff382d3fbe7f tempest-GroupsV320Test-1171012732 None] Group tempest-GroupsV320Test-Group-471810475: created successfully Nov 06 21:26:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9fb53b86-1575-4b4d-803c-ff382d3fbe7f tempest-GroupsV320Test-1171012732 None] Create group completed successfully. Nov 06 21:26:41 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" returned: 0 in 0.317s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8b50b8-1f17-4440-bfba-811472fa3e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03174eba01b489385c8d1c2a439005c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:38Z,use_quota=True,user_id='839526528b914c898daf6a9c4f6eb3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Creating volume 0c8b50b8-1f17-4440-bfba-811472fa3e95 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:41 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:41 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 1073741824 Nov 06 21:26:41 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Attempting download of 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f3d07-57f5-4048-81e9-2917a28062b1]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_ot5q5ka0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:41 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_ot5q5ka0 Nov 06 21:26:41 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:41 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_ot5q5ka0" returned: 0 in 0.385s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_ot5q5ka0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:42 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 1073741824" returned: 0 in 0.543s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:42 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 Nov 06 21:26:42 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:42 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_ot5q5ka0 Nov 06 21:26:42 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:42 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_ot5q5ka0" returned: 1 in 0.405s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_ot5q5ka0' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b510051d-8bac-4305-af77-e919e642b4d8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:42 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Attempting download of 7d895d99-a7c3-4be8-9679-bd9b0e97d013 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'metadata': {}}])) to volume 0c8b50b8-1f17-4440-bfba-811472fa3e95. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbbb169-b545-47b2-84b3-1f234a5261a3]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d895d99-a7c3-4be8-9679-bd9b0e97d013_gkilxj0i {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:42 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD Nov 06 21:26:42 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-83be1d4a-85e9-44d2-aa73-a1cceb5ad869 req-eadfc0f9-209f-4858-b079-cc68d245831b tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Terminate volume connection completed successfully. Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-83be1d4a-85e9-44d2-aa73-a1cceb5ad869 req-eadfc0f9-209f-4858-b079-cc68d245831b tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Deleting attachment d4491707-76e6-4e9d-9840-7bbf9eff8bf1. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:26:42 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d895d99-a7c3-4be8-9679-bd9b0e97d013_gkilxj0i Nov 06 21:26:42 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:42 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] 8c7c38c6-44d6-4400-a543-dd1512f9cf56 was qcow2, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:26:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:42 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 Nov 06 21:26:42 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:43 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d895d99-a7c3-4be8-9679-bd9b0e97d013_gkilxj0i" returned: 0 in 0.511s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d895d99-a7c3-4be8-9679-bd9b0e97d013_gkilxj0i {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:43 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d895d99-a7c3-4be8-9679-bd9b0e97d013_gkilxj0i Nov 06 21:26:43 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Created reservations ['1d577e13-68e5-4bdc-9040-8a74c5923c6a'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:43 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:43 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:43 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d895d99-a7c3-4be8-9679-bd9b0e97d013_gkilxj0i" returned: 1 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d895d99-a7c3-4be8-9679-bd9b0e97d013_gkilxj0i' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdbd82a-0b15-4115-bf16-62e49c070625]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:43 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD Nov 06 21:26:43 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Acquiring lock "cinder-a6d6b028-0773-4bac-876e-cfdc72eb63bf-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "cinder-a6d6b028-0773-4bac-876e-cfdc72eb63bf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Acquiring lock "cinder-quobyte-a6d6b028-0773-4bac-876e-cfdc72eb63bf" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:43 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "cinder-quobyte-a6d6b028-0773-4bac-876e-cfdc72eb63bf" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.378s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:43 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4718ac36-361f-43f4-a82e-4b98d8f1978e tempest-GroupsV320Test-1171012732 None] Delete group completed successfully. Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af8215c-b966-425b-ab56-fcec2b3db3dd]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:43 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf Nov 06 21:26:43 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:43 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:43 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD Nov 06 21:26:43 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:44 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf" returned: 0 in 0.470s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:44 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf Nov 06 21:26:44 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:44 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] 7d895d99-a7c3-4be8-9679-bd9b0e97d013 was raw, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:44 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 Nov 06 21:26:44 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:44 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a6d6b028-0773-4bac-876e-cfdc72eb63bf" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "cinder-quobyte-a6d6b028-0773-4bac-876e-cfdc72eb63bf" released by "delete_volume" :: held 0.889s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Created reservations ['f9183aa5-923a-440b-9bf6-99dcd7d8788b', 'e213fd06-83ab-4cce-a123-6e1b565b0b4b', '3977f24f-58f4-49b9-8b98-77da135424f3', '42e2ec1a-3d55-4a43-a11c-17c3918ee3e3'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:44 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:44 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:45 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95" returned: 0 in 0.805s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d895d99-a7c3-4be8-9679-bd9b0e97d013_2zcvq7ijdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:26:45 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:45 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 1G Nov 06 21:26:45 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:45 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.435s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Deleted volume successfully. Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-900f9a6c-67c2-41d1-94b4-285257534a73 tempest-TestServerVolumeAttachScenarioOldVersion-21793826 None] Lock "cinder-a6d6b028-0773-4bac-876e-cfdc72eb63bf-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:45 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" returned: 0 in 2.900s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_fm2h7743devstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:26:45 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Converted 112.00 MB image at 38.59 MB/s Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:45 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 1G Nov 06 21:26:45 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:45 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 1G" returned: 0 in 0.786s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Downloaded image 7d895d99-a7c3-4be8-9679-bd9b0e97d013 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'metadata': {}}])) to volume 0c8b50b8-1f17-4440-bfba-811472fa3e95 successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Temporary image 7d895d99-a7c3-4be8-9679-bd9b0e97d013 for user 839526528b914c898daf6a9c4f6eb3b3 is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Marking volume 0c8b50b8-1f17-4440-bfba-811472fa3e95 as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Copying metadata from image 7d895d99-a7c3-4be8-9679-bd9b0e97d013 to 0c8b50b8-1f17-4440-bfba-811472fa3e95. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:26:45 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Creating volume glance metadata for volume 0c8b50b8-1f17-4440-bfba-811472fa3e95 backed by image 7d895d99-a7c3-4be8-9679-bd9b0e97d013 with: {'image_id': '7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c0ee4263e10c7d27008b4af3a62d67d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13329e89-f93c-4024-8f7d-48d986e967b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8b50b8-1f17-4440-bfba-811472fa3e95', 'volume_size': 1, 'image_id': '7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0ee4263e10c7d27008b4af3a62d67d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f03174eba01b489385c8d1c2a439005c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a632863be36029a77ad831b807efc96354862f16192499cb5399326817f3abd4184af1caa121a916f4ac58d23b7adc88f478fa33dadc681f52d0f3af0e32d01', 'id': '7d895d99-a7c3-4be8-9679-bd9b0e97d013', 'created_at': datetime.datetime(2026, 11, 6, 20, 26, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 26, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d895d99-a7c3-4be8-9679-bd9b0e97d013/file', 'properties': {}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833be0a-e93c-4e1d-bb35-66de6f0d00cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:46 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Volume volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 (0c8b50b8-1f17-4440-bfba-811472fa3e95): created successfully Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833be0a-e93c-4e1d-bb35-66de6f0d00cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Flow 'volume_create_manager' (9185db54-aa21-45de-a943-f975e7d74bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2100ddd2-93e2-4392-8098-a279a55b2b64 tempest-VolumeImageDependencyTests-899130787 None] Created volume successfully. Nov 06 21:26:46 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 1G" returned: 0 in 0.520s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Downloaded image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 for user 060f6ea987ac447c8a0e57bf463e0a91 is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Marking volume dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Copying metadata from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 to dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Creating volume glance metadata for volume dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 backed by image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacc1fc6-e955-492e-b95e-dbb113fcf246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882ac2cb-d7b1-407b-8d7f-4ce1fed8e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:46 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Volume volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 (dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4): created successfully Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882ac2cb-d7b1-407b-8d7f-4ce1fed8e18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Flow 'volume_create_manager' (569e6f16-19d7-471f-833a-ee7fb49d24c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-eefc470c-d954-4a72-9960-41ba464e95d7 tempest-VolumesExtendTest-1346360795 None] Created volume successfully. Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Acquiring lock "cinder-0c8b50b8-1f17-4440-bfba-811472fa3e95-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Lock "cinder-0c8b50b8-1f17-4440-bfba-811472fa3e95-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Acquiring lock "cinder-quobyte-0c8b50b8-1f17-4440-bfba-811472fa3e95" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Lock "cinder-quobyte-0c8b50b8-1f17-4440-bfba-811472fa3e95" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c2262-a881-4313-83d9-270a2fbd1953]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:47 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 Nov 06 21:26:47 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:47 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95" returned: 0 in 0.476s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:47 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95 Nov 06 21:26:47 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:47 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0c8b50b8-1f17-4440-bfba-811472fa3e95" returned: 0 in 0.386s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Lock "cinder-quobyte-0c8b50b8-1f17-4440-bfba-811472fa3e95" released by "delete_volume" :: held 0.934s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Created reservations ['da470005-740e-4b5d-aba2-62a46682060d', '7b036894-2f81-4c82-bbaa-942fc0865ad4', '2e2522ce-ee74-482d-a210-c1c6b6f15afb', '0bb3291f-77ed-4800-acbe-ccac489a1df0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d32d885-a816-403f-acc5-1ebd36981cba]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:47 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:47 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:47 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 Nov 06 21:26:48 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:48 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:48 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Deleted volume successfully. Nov 06 21:26:48 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" returned: 0 in 0.524s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 2G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8547c27-86c7-4d44-8a2d-39b3c455a6b8 tempest-VolumeImageDependencyTests-899130787 None] Lock "cinder-0c8b50b8-1f17-4440-bfba-811472fa3e95-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 2G" returned: 0 in 0.117s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.684s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d0d30c05-3691-4e1d-ba7c-467b0e9e07b2 tempest-VolumesExtendTest-1346360795 None] Extend volume completed successfully. Nov 06 21:26:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "cinder-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Lock "cinder-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "cinder-quobyte-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc54429-6b90-45b7-996e-6e291dd2d9bb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:50 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 Nov 06 21:26:50 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:50 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" returned: 0 in 0.527s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:50 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4 Nov 06 21:26:50 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:50 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4" released by "delete_volume" :: held 0.894s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Created reservations ['a1112cdd-3de1-406f-9145-e9da3138d5c0', '52921f78-2167-473d-b220-fb05f44ac898', '471a758a-5b28-4acb-8be2-11220edc70cd', '3a07f2c0-3f14-4936-aa09-a7965964f715'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:51 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:51 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:51 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.537s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Deleted volume successfully. Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a8e34941-eee0-4dc3-8bc5-b60ad3d24832 tempest-VolumesExtendTest-1346360795 None] Lock "cinder-dcd659a0-fdc8-4cbd-b6c6-36993ee0a5b4-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Flow 'volume_create_manager' (26b10542-1416-4e63-976b-a55e9aa89b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c2b4b1-e37c-44c8-b37b-a292a3b4bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c2b4b1-e37c-44c8-b37b-a292a3b4bf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1325637203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94618cc-6c47-4157-84eb-d34e3f8ed959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b64e819d6540ce90ee56284a9d20b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:52Z,use_quota=True,user_id='060f6ea987ac447c8a0e57bf463e0a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bec1eb-68d9-4bfc-b83c-07783f4485b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bec1eb-68d9-4bfc-b83c-07783f4485b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b98f893-b32e-4c78-8107-ecbf45634774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b98f893-b32e-4c78-8107-ecbf45634774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94618cc-6c47-4157-84eb-d34e3f8ed959', 'volume_name': 'volume-c94618cc-6c47-4157-84eb-d34e3f8ed959', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988860c7-61e0-4060-be57-0bc499b84b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988860c7-61e0-4060-be57-0bc499b84b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97897932-bb15-434a-8641-32343c2bd14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:51 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Volume c94618cc-6c47-4157-84eb-d34e3f8ed959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94618cc-6c47-4157-84eb-d34e3f8ed959', 'volume_size': 1} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1325637203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94618cc-6c47-4157-84eb-d34e3f8ed959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b64e819d6540ce90ee56284a9d20b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:52Z,use_quota=True,user_id='060f6ea987ac447c8a0e57bf463e0a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Creating volume c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:51 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:51 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 1073741824 Nov 06 21:26:51 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:52 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 1073741824" returned: 0 in 0.651s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:52 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 Nov 06 21:26:52 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:52 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959" returned: 0 in 0.342s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97897932-bb15-434a-8641-32343c2bd14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94618cc-6c47-4157-84eb-d34e3f8ed959', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5a3e0b-1b53-41c7-9ff1-3b118ee31d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:52 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Volume volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 (c94618cc-6c47-4157-84eb-d34e3f8ed959): created successfully Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5a3e0b-1b53-41c7-9ff1-3b118ee31d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Flow 'volume_create_manager' (26b10542-1416-4e63-976b-a55e9aa89b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-888e3abb-793e-445f-a9dc-31fe902ee8e1 tempest-VolumesExtendTest-1346360795 None] Created volume successfully. Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Flow 'volume_create_manager' (2237f0ab-6b2e-447c-87b9-ef15e61b6d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08210caf-38b2-47fc-a258-a978c448b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08210caf-38b2-47fc-a258-a978c448b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1101804356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c10729-c09c-4d24-8742-5f6d50408838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d87e0f24ef0435fb613975af7835a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:54Z,use_quota=True,user_id='dc82aa7f4f7b427f87c11dfe2a8c16dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20cd8fc-34bf-418f-ac3c-dae52bf79650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20cd8fc-34bf-418f-ac3c-dae52bf79650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4be907d-dd96-49b0-a134-2f51e8787662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4be907d-dd96-49b0-a134-2f51e8787662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c10729-c09c-4d24-8742-5f6d50408838', 'volume_name': 'volume-d1c10729-c09c-4d24-8742-5f6d50408838', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902eabc9-efcb-435a-b72c-7c445bc25867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902eabc9-efcb-435a-b72c-7c445bc25867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5796b3e-387b-460a-9611-c3ddcf3908f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:53 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Volume d1c10729-c09c-4d24-8742-5f6d50408838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c10729-c09c-4d24-8742-5f6d50408838', 'volume_size': 1} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1101804356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c10729-c09c-4d24-8742-5f6d50408838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d87e0f24ef0435fb613975af7835a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:54Z,use_quota=True,user_id='dc82aa7f4f7b427f87c11dfe2a8c16dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Creating volume d1c10729-c09c-4d24-8742-5f6d50408838 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:54 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:54 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 1073741824 Nov 06 21:26:54 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:54 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 1073741824" returned: 0 in 0.546s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:54 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 Nov 06 21:26:54 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:54 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838" returned: 0 in 0.293s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.558s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5796b3e-387b-460a-9611-c3ddcf3908f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c10729-c09c-4d24-8742-5f6d50408838', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251c1692-58d1-43b1-821c-f4064a73e300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Creating offline snapshot 6373c9e2-03f2-4b41-b0aa-d747d45fab6e of volume c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:26:54 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Volume volume-d1c10729-c09c-4d24-8742-5f6d50408838 (d1c10729-c09c-4d24-8742-5f6d50408838): created successfully Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251c1692-58d1-43b1-821c-f4064a73e300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Flow 'volume_create_manager' (2237f0ab-6b2e-447c-87b9-ef15e61b6d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c47e586-2ccf-4c0d-a813-4c91bdf8ca09]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:55 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e5d6118d-0a5c-4cd4-b40a-0ed8b2aa50c7 tempest-VolumesServicesTestJSON-523946292 None] Created volume successfully. Nov 06 21:26:55 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 Nov 06 21:26:55 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:55 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959" returned: 0 in 0.535s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:55 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e 1G Nov 06 21:26:55 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:56 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e 1G" returned: 0 in 0.688s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Acquiring lock "cinder-d1c10729-c09c-4d24-8742-5f6d50408838-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:56 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e Nov 06 21:26:56 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Lock "cinder-d1c10729-c09c-4d24-8742-5f6d50408838-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Acquiring lock "cinder-quobyte-d1c10729-c09c-4d24-8742-5f6d50408838" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Lock "cinder-quobyte-d1c10729-c09c-4d24-8742-5f6d50408838" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[214544c9-6fa1-47fb-8d75-b5dde613f18e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:56 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 Nov 06 21:26:56 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:56 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e" returned: 0 in 0.534s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:56 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e is being set with open permissions: ugo+rw Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:56 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e Nov 06 21:26:56 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:56 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838" returned: 0 in 0.503s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:56 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838 Nov 06 21:26:56 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:57 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e" returned: 0 in 0.372s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:57 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.info Nov 06 21:26:57 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:57 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d1c10729-c09c-4d24-8742-5f6d50408838" returned: 0 in 0.320s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Lock "cinder-quobyte-d1c10729-c09c-4d24-8742-5f6d50408838" released by "delete_volume" :: held 0.904s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Created reservations ['78b6c270-71fc-4c0e-a3f7-04f034f95fce', 'c3c3fd89-cdfe-4176-a586-ebc115ba3f83', '254c9bb7-4a65-4f7b-8ad7-5707d0431b66', '07613ed8-aec7-455c-b3bb-8831ca419b08'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:57 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.info" returned: 0 in 0.377s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:57 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.info is being set with open permissions: ugo+rw Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:57 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:26:57 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:57 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.info Nov 06 21:26:57 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:57 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.374s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:57 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Deleted volume successfully. Nov 06 21:26:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-746e2f2c-dbc9-4023-a516-f1584214c384 tempest-VolumesServicesTestJSON-523946292 None] Lock "cinder-d1c10729-c09c-4d24-8742-5f6d50408838-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:58 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.info" returned: 0 in 0.491s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.167s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-eb756707-8f80-4945-888b-bd41d1c15f68 tempest-VolumesExtendTest-1346360795 None] Create snapshot completed successfully Nov 06 21:26:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:58 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3c145-1ac7-44c2-b3b8-85c23b02fcad]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:58 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 Nov 06 21:26:58 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:59 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959" returned: 0 in 0.527s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e 2G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e 2G" returned: 0 in 0.213s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.797s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8ae6972b-fbad-452e-82dd-860b8e3ccc18 tempest-VolumesExtendTest-1346360795 None] Extend volume completed successfully. Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Acquiring lock "cinder-6373c9e2-03f2-4b41-b0aa-d747d45fab6e-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-6373c9e2-03f2-4b41-b0aa-d747d45fab6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Acquiring lock "cinder-quobyte-c94618cc-6c47-4157-84eb-d34e3f8ed959" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-c94618cc-6c47-4157-84eb-d34e3f8ed959" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Acquiring lock "cinder-quobyte-6373c9e2-03f2-4b41-b0aa-d747d45fab6e" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-6373c9e2-03f2-4b41-b0aa-d747d45fab6e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Deleting offline snapshot 6373c9e2-03f2-4b41-b0aa-d747d45fab6e of volume c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] snapshot_file for this snap is: volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16f747d-1ac4-456b-afec-8cd83bfa2120]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:00 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e Nov 06 21:27:00 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:00 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e" returned: 0 in 0.467s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94618cc-6c47-4157-84eb-d34e3f8ed959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[477b7b2c-1c2c-499f-bb01-a231293e7cf1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:00 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 Nov 06 21:27:00 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:01 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959" returned: 0 in 0.470s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:01 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e Nov 06 21:27:01 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:01 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e" returned: 0 in 0.669s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:01 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e Nov 06 21:27:01 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (a0c17943-fa2a-4225-997e-df000bdaab6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8016577b-4958-4f5c-b581-74904dff8796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8016577b-4958-4f5c-b581-74904dff8796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482610235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea42859c-84d0-409a-a4d5-74af15e42dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:02Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e92622-5a45-45cc-8182-db838a0e7fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e92622-5a45-45cc-8182-db838a0e7fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab6166b-93c2-45ff-be87-184ff8ac9113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab6166b-93c2-45ff-be87-184ff8ac9113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea42859c-84d0-409a-a4d5-74af15e42dd7', 'volume_name': 'volume-ea42859c-84d0-409a-a4d5-74af15e42dd7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffb6abc-d9d5-46f5-aa00-bada2d813bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffb6abc-d9d5-46f5-aa00-bada2d813bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1eb938-0a5a-48a1-ba75-e12d0ca497c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:02 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Volume ea42859c-84d0-409a-a4d5-74af15e42dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea42859c-84d0-409a-a4d5-74af15e42dd7', 'volume_size': 1} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482610235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea42859c-84d0-409a-a4d5-74af15e42dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:02Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Creating volume ea42859c-84d0-409a-a4d5-74af15e42dd7 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:02 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:02 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959.6373c9e2-03f2-4b41-b0aa-d747d45fab6e" returned: 0 in 0.423s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:02 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 1073741824 Nov 06 21:27:02 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-6373c9e2-03f2-4b41-b0aa-d747d45fab6e" released by "_delete_snapshot" :: held 2.269s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-c94618cc-6c47-4157-84eb-d34e3f8ed959" released by "delete_snapshot" :: held 2.300s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Created reservations ['763d4d2f-3fd1-47e2-9665-128be5bab61c', '565b692c-d741-431d-9942-cf189d01b4d7', '147739ba-2dfe-43c9-bf3b-4b50fd48b6ab', 'd98bb370-e909-4db7-9d57-c225cfdedee0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Delete snapshot completed successfully. Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-12400260-785d-4382-ad4b-b89a3aed386d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-6373c9e2-03f2-4b41-b0aa-d747d45fab6e-delete_snapshot" released by "delete_snapshot" :: held 2.509s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:02 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 1073741824" returned: 0 in 0.562s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:02 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 Nov 06 21:27:02 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:03 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7" returned: 0 in 0.384s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1eb938-0a5a-48a1-ba75-e12d0ca497c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea42859c-84d0-409a-a4d5-74af15e42dd7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c33ced-2f74-4199-8101-61c855f598aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:03 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Volume volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 (ea42859c-84d0-409a-a4d5-74af15e42dd7): created successfully Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c33ced-2f74-4199-8101-61c855f598aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (a0c17943-fa2a-4225-997e-df000bdaab6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8b3499cc-7a56-4e07-85a0-0eb21268188e tempest-ProjectReaderTests-858085261 None] Created volume successfully. Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Acquiring lock "cinder-c94618cc-6c47-4157-84eb-d34e3f8ed959-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-c94618cc-6c47-4157-84eb-d34e3f8ed959-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Acquiring lock "cinder-quobyte-c94618cc-6c47-4157-84eb-d34e3f8ed959" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-c94618cc-6c47-4157-84eb-d34e3f8ed959" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2462cb-d320-469b-9e38-86e21a361df6]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:03 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 Nov 06 21:27:03 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:03 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959" returned: 0 in 0.416s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:04 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959 Nov 06 21:27:04 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:04 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c94618cc-6c47-4157-84eb-d34e3f8ed959" returned: 0 in 0.305s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-quobyte-c94618cc-6c47-4157-84eb-d34e3f8ed959" released by "delete_volume" :: held 0.802s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Created reservations ['507ac47e-bea3-405a-a175-a62c5270b919', '0a0681e6-7017-492e-af63-a5621a947b41', '8a73b79c-8836-48a5-88df-a329301ca46b', 'eb7487a5-66e7-48fe-821b-7033e0d6c4c5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:04 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:04 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-ea42859c-84d0-409a-a4d5-74af15e42dd7-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Lock "cinder-ea42859c-84d0-409a-a4d5-74af15e42dd7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-quobyte-ea42859c-84d0-409a-a4d5-74af15e42dd7" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:04 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.359s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-ea42859c-84d0-409a-a4d5-74af15e42dd7" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Deleted volume successfully. Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[872d4b55-c055-425d-ba4a-de2568f16dc9]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7a8a6203-6f5e-4ff3-bfa0-5671f312f35d tempest-VolumesExtendTest-1346360795 None] Lock "cinder-c94618cc-6c47-4157-84eb-d34e3f8ed959-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:05 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 Nov 06 21:27:05 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7" returned: 0 in 0.438s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7 Nov 06 21:27:05 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ea42859c-84d0-409a-a4d5-74af15e42dd7" returned: 0 in 0.254s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-ea42859c-84d0-409a-a4d5-74af15e42dd7" released by "delete_volume" :: held 0.777s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Created reservations ['fa543daa-fa77-48e2-b2c5-adb91ba16bde', 'e8a081c4-8588-4669-ac2a-3fc20094602a', '667342bf-6896-4581-b46c-1b38299c9dfc', '39acae94-d1b3-4139-a41a-6e32f6f09efb'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:05 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.410s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:06 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Deleted volume successfully. Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2444d192-e2c2-461a-8f26-d814239a428d tempest-ProjectReaderTests-858085261 None] Lock "cinder-ea42859c-84d0-409a-a4d5-74af15e42dd7-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (f611b70a-a784-443f-a6e1-2754c9ba3310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3feacaca-4885-4802-a220-5a5c2db416ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3feacaca-4885-4802-a220-5a5c2db416ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168158823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1735ef7-d3dd-4674-941d-6e430721a3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:07Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f831cbcf-59c5-4f84-b409-2ebb88688df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f831cbcf-59c5-4f84-b409-2ebb88688df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90ce1ff-c1da-4bd4-856e-30a9a37ff4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90ce1ff-c1da-4bd4-856e-30a9a37ff4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1735ef7-d3dd-4674-941d-6e430721a3a2', 'volume_name': 'volume-a1735ef7-d3dd-4674-941d-6e430721a3a2', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e22f4b6-fe0f-4a0d-9853-fc1e779af2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e22f4b6-fe0f-4a0d-9853-fc1e779af2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d50081-f12e-44d4-84be-df7655d0369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:06 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Volume a1735ef7-d3dd-4674-941d-6e430721a3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1735ef7-d3dd-4674-941d-6e430721a3a2', 'volume_size': 1} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168158823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1735ef7-d3dd-4674-941d-6e430721a3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:07Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Creating volume a1735ef7-d3dd-4674-941d-6e430721a3a2 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:06 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 1073741824 Nov 06 21:27:06 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:07 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 1073741824" returned: 0 in 0.634s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:07 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 Nov 06 21:27:07 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:07 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2" returned: 0 in 0.432s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d50081-f12e-44d4-84be-df7655d0369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1735ef7-d3dd-4674-941d-6e430721a3a2', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573963c9-e316-44ce-8da9-e9f0dfa64cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Volume volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 (a1735ef7-d3dd-4674-941d-6e430721a3a2): created successfully Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573963c9-e316-44ce-8da9-e9f0dfa64cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (f611b70a-a784-443f-a6e1-2754c9ba3310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-dd1caf7b-fb9d-4400-88ad-fda5ac316307 tempest-ProjectReaderTests-858085261 None] Created volume successfully. Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Flow 'volume_create_manager' (1d86ecc8-7b35-4c02-b1c9-ea6e09b6d00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ffa736-764b-4d8a-828c-f4ee98d735f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ffa736-764b-4d8a-828c-f4ee98d735f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1862308701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3139601-450c-48f1-a17c-8742263211d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fe744fc679494aa93c68c83f029079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:08Z,use_quota=True,user_id='b84faea3a0dc4fcea018e6b3813c153a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9f0b23-ea79-421d-af5b-22bb0abbffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9f0b23-ea79-421d-af5b-22bb0abbffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ac9f3a-2f1d-478e-b79b-d39d9c096f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ac9f3a-2f1d-478e-b79b-d39d9c096f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3139601-450c-48f1-a17c-8742263211d8', 'volume_name': 'volume-d3139601-450c-48f1-a17c-8742263211d8', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e0e596-4e4d-4e1a-a648-5587feb56e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e0e596-4e4d-4e1a-a648-5587feb56e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060b31fe-035e-484f-98da-542feb93d984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:08 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Volume d3139601-450c-48f1-a17c-8742263211d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3139601-450c-48f1-a17c-8742263211d8', 'volume_size': 1} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1862308701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3139601-450c-48f1-a17c-8742263211d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fe744fc679494aa93c68c83f029079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:08Z,use_quota=True,user_id='b84faea3a0dc4fcea018e6b3813c153a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Creating volume d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:08 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:08 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 1073741824 Nov 06 21:27:08 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:08 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 1073741824" returned: 0 in 0.522s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:08 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 Nov 06 21:27:08 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-a1735ef7-d3dd-4674-941d-6e430721a3a2-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Lock "cinder-a1735ef7-d3dd-4674-941d-6e430721a3a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-quobyte-a1735ef7-d3dd-4674-941d-6e430721a3a2" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-a1735ef7-d3dd-4674-941d-6e430721a3a2" acquired by "delete_volume" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a8b51-2b8a-4ac0-9c87-cadea21547c5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:09 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8" returned: 0 in 0.424s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060b31fe-035e-484f-98da-542feb93d984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3139601-450c-48f1-a17c-8742263211d8', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bb004a-c497-48bf-9832-6565dd76b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:09 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Volume volume-d3139601-450c-48f1-a17c-8742263211d8 (d3139601-450c-48f1-a17c-8742263211d8): created successfully Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bb004a-c497-48bf-9832-6565dd76b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Flow 'volume_create_manager' (1d86ecc8-7b35-4c02-b1c9-ea6e09b6d00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5f795047-e346-444e-b200-3d4b66ce00e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Created volume successfully. Nov 06 21:27:09 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 Nov 06 21:27:09 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:09 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2" returned: 0 in 0.461s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:09 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2 Nov 06 21:27:09 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:09 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a1735ef7-d3dd-4674-941d-6e430721a3a2" returned: 0 in 0.277s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-a1735ef7-d3dd-4674-941d-6e430721a3a2" released by "delete_volume" :: held 0.822s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Created reservations ['1362606f-db8e-4ba2-a6b6-1a06da12699e', 'fd08ed4d-4f48-49b7-ae3d-6a97634504b3', '8be0da9b-d61c-4ef7-8a5b-c25652e9bec3', '3d1c59e1-9de4-49ac-97e2-52d091405cf6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:09 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:09 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:10 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.316s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Deleted volume successfully. Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e568759c-acc6-4293-aa61-64a2d3a874c2 tempest-ProjectReaderTests-858085261 None] Lock "cinder-a1735ef7-d3dd-4674-941d-6e430721a3a2-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Flow 'volume_create_manager' (ae326b9d-1d79-4da6-bf7d-dd538c5bb766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffeb3bc-e89d-4597-8f1a-d3310713118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffeb3bc-e89d-4597-8f1a-d3310713118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1941587420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37385d84-a248-4bc5-a07b-ca62fbb70811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdedfd3193e14b63afe39b2ec893732d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:10Z,use_quota=True,user_id='5979db5c1f794446bdc014984e67efd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a08c5b-6b55-4453-a747-ad347848d2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a08c5b-6b55-4453-a747-ad347848d2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2a7ff0-3ddd-4391-ae50-3d417bff57af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2a7ff0-3ddd-4391-ae50-3d417bff57af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37385d84-a248-4bc5-a07b-ca62fbb70811', 'volume_name': 'volume-37385d84-a248-4bc5-a07b-ca62fbb70811', 'volume_size': 2}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7a59f0-9a91-43d1-a724-19b6856576f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7a59f0-9a91-43d1-a724-19b6856576f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d65e5f3-5a65-4624-a313-cb44f4f05a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Volume 37385d84-a248-4bc5-a07b-ca62fbb70811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37385d84-a248-4bc5-a07b-ca62fbb70811', 'volume_size': 2} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1941587420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37385d84-a248-4bc5-a07b-ca62fbb70811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdedfd3193e14b63afe39b2ec893732d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:10Z,use_quota=True,user_id='5979db5c1f794446bdc014984e67efd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Creating volume 37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:10 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 2147483648 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:10 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 2147483648 Nov 06 21:27:10 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (cc22cd14-6410-405c-b487-919320bc7040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99c0d88-9cbc-44ad-80d8-171bb3c9d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99c0d88-9cbc-44ad-80d8-171bb3c9d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995546525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04a5474-237f-4951-8951-2fc58a48d56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:11Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbc1619-9813-4515-850c-9cf45fb10cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbc1619-9813-4515-850c-9cf45fb10cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51344043-f40f-443f-a796-606f4f151fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51344043-f40f-443f-a796-606f4f151fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04a5474-237f-4951-8951-2fc58a48d56d', 'volume_name': 'volume-d04a5474-237f-4951-8951-2fc58a48d56d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd071bb-5740-4dc6-8450-385c101344ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd071bb-5740-4dc6-8450-385c101344ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0e03a0-c2b2-44c7-b6d4-a78ed6e04e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:10 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Volume d04a5474-237f-4951-8951-2fc58a48d56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04a5474-237f-4951-8951-2fc58a48d56d', 'volume_size': 1} Nov 06 21:27:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:11 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 2147483648" returned: 0 in 0.571s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 Nov 06 21:27:11 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:11 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.722s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Creating offline snapshot 3f7c68cf-db76-4814-8f79-a6cf622975af of volume d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d65e5f3-5a65-4624-a313-cb44f4f05a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37385d84-a248-4bc5-a07b-ca62fbb70811', 'volume_size': 2}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:11 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e6b32a-2b34-4274-84ee-81307fde4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eb6eb4-54cc-4f3a-bd74-3b84842da8b2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.331s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:27:11 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Volume volume-37385d84-a248-4bc5-a07b-ca62fbb70811 (37385d84-a248-4bc5-a07b-ca62fbb70811): created successfully Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e6b32a-2b34-4274-84ee-81307fde4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Flow 'volume_create_manager' (ae326b9d-1d79-4da6-bf7d-dd538c5bb766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:11 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b8429a39-2bfc-479e-8c7e-ca1f9afe17d3 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Created volume successfully. Nov 06 21:27:11 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 Nov 06 21:27:11 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8" returned: 0 in 0.396s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af 1G Nov 06 21:27:11 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Flow 'volume_create_manager' (8adb4511-6b23-465b-9b25-c1ca5bfa811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963f48c6-4c84-4269-9e13-1ec4c50e0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963f48c6-4c84-4269-9e13-1ec4c50e0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0d2d2d-9df4-4618-9227-fdf92c73d08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be2e683e06a44f7b19fd89f8ab2f527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:12Z,use_quota=True,user_id='db0ccf9136be4ac0a8160b3ed65d78a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a84a6389-6af7-4bb0-8626-8c16f3128758),volume_type_id=a84a6389-6af7-4bb0-8626-8c16f3128758)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52768758-922e-4130-92cc-493c3fb25163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52768758-922e-4130-92cc-493c3fb25163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b8ceed-6ef1-43b7-8f5d-ff64e6ebeb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:27:12 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af 1G" returned: 0 in 0.434s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3139601-450c-48f1-a17c-8742263211d8 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3139601-450c-48f1-a17c-8742263211d8 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af Nov 06 21:27:12 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b8ceed-6ef1-43b7-8f5d-ff64e6ebeb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be0d2d2d-9df4-4618-9227-fdf92c73d08e', 'volume_name': 'volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e', 'volume_size': 1, 'image_id': '0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05d40c8162780c1cf54b63a38570b5ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4be2e683e06a44f7b19fd89f8ab2f527', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03ee88aba613111d2c5945cdfe979bf6c9f22df48c347a02a46cfc2a83f8888e3ebd1091e52e405928f3d06b20a136fc525f746875fb7e672e92554aa5cceb15', 'id': '0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'created_at': datetime.datetime(2026, 11, 6, 20, 27, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17873e59-f021-4884-bdf6-5335a853409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17873e59-f021-4884-bdf6-5335a853409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eccf6e-e2e2-4f5f-a65d-78c18f5f1795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:12 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Volume be0d2d2d-9df4-4618-9227-fdf92c73d08e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e', 'volume_size': 1, 'image_id': '0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05d40c8162780c1cf54b63a38570b5ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4be2e683e06a44f7b19fd89f8ab2f527', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03ee88aba613111d2c5945cdfe979bf6c9f22df48c347a02a46cfc2a83f8888e3ebd1091e52e405928f3d06b20a136fc525f746875fb7e672e92554aa5cceb15', 'id': '0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'created_at': datetime.datetime(2026, 11, 6, 20, 27, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Trying to clone be0d2d2d-9df4-4618-9227-fdf92c73d08e from image 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:27:12 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4834ce2-bfa0-4708-80bd-a5b4cb2c9497]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3139601-450c-48f1-a17c-8742263211d8 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af" returned: 0 in 0.348s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af is being set with open permissions: ugo+rw Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af Nov 06 21:27:12 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:12 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD Nov 06 21:27:12 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:12 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af" returned: 0 in 0.300s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.info Nov 06 21:27:12 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD Nov 06 21:27:13 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.info" returned: 0 in 0.257s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:13 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.info is being set with open permissions: ugo+rw Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:13 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.info Nov 06 21:27:13 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Temporary image 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 is fetched for user db0ccf9136be4ac0a8160b3ed65d78a6. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=231,cinder:DELETE=15,cinder:SELECT=196,cinder:INSERT=60 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb82806-0272-4050-9498-36891454b137]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:13 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.info" returned: 0 in 0.265s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:13 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD Nov 06 21:27:13 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995546525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04a5474-237f-4951-8951-2fc58a48d56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:11Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Creating volume d04a5474-237f-4951-8951-2fc58a48d56d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:13 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2fbe50e6-e3ff-4009-86f8-d3a5a9df9963 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Create snapshot completed successfully Nov 06 21:27:13 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d 1073741824 Nov 06 21:27:13 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:13 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD Nov 06 21:27:13 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:14 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d 1073741824" returned: 0 in 0.543s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:14 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:14 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d Nov 06 21:27:14 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "cinder-3f7c68cf-db76-4814-8f79-a6cf622975af-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-3f7c68cf-db76-4814-8f79-a6cf622975af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "cinder-quobyte-d3139601-450c-48f1-a17c-8742263211d8" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-quobyte-d3139601-450c-48f1-a17c-8742263211d8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "cinder-quobyte-3f7c68cf-db76-4814-8f79-a6cf622975af" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-quobyte-3f7c68cf-db76-4814-8f79-a6cf622975af" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Deleting offline snapshot 3f7c68cf-db76-4814-8f79-a6cf622975af of volume d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] snapshot_file for this snap is: volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53fd1a6-969a-4acd-9e1c-2ccb0432c7db]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:14 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d" returned: 0 in 0.296s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.742s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0e03a0-c2b2-44c7-b6d4-a78ed6e04e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04a5474-237f-4951-8951-2fc58a48d56d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a23873-9bc6-4ecb-a3f2-424e9fbe82ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Creating offline snapshot 93cf3574-0059-433b-93d4-8e7bbd0d096c of volume 37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:27:14 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Volume volume-d04a5474-237f-4951-8951-2fc58a48d56d (d04a5474-237f-4951-8951-2fc58a48d56d): created successfully Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a23873-9bc6-4ecb-a3f2-424e9fbe82ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (cc22cd14-6410-405c-b487-919320bc7040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5399532c-705e-4a17-8546-230896270997]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:14 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9ae4fbc0-1277-467e-a989-2039321e8334 tempest-ProjectReaderTests-858085261 None] Created volume successfully. Nov 06 21:27:14 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af Nov 06 21:27:14 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:14 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 Nov 06 21:27:14 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:14 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af" returned: 0 in 0.410s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3139601-450c-48f1-a17c-8742263211d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb6d0bd-99e9-45be-8402-9f3c3e5f4650]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:14 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811" returned: 0 in 0.392s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c 2G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:14 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c 2G Nov 06 21:27:14 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:14 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 Nov 06 21:27:14 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-d04a5474-237f-4951-8951-2fc58a48d56d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Lock "cinder-d04a5474-237f-4951-8951-2fc58a48d56d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-quobyte-d04a5474-237f-4951-8951-2fc58a48d56d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-d04a5474-237f-4951-8951-2fc58a48d56d" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea2206-c7b8-40be-81ce-a4344f1cb4f8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8" returned: 0 in 0.491s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d Nov 06 21:27:15 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c 2G" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37385d84-a248-4bc5-a07b-ca62fbb70811 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af Nov 06 21:27:15 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37385d84-a248-4bc5-a07b-ca62fbb70811 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c Nov 06 21:27:15 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d" returned: 0 in 0.427s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d Nov 06 21:27:15 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37385d84-a248-4bc5-a07b-ca62fbb70811 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c" returned: 0 in 0.334s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c is being set with open permissions: ugo+rw Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af" returned: 0 in 0.373s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c Nov 06 21:27:15 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af Nov 06 21:27:15 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d04a5474-237f-4951-8951-2fc58a48d56d" returned: 0 in 0.268s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-d04a5474-237f-4951-8951-2fc58a48d56d" released by "delete_volume" :: held 0.747s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:15 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c" returned: 0 in 0.272s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8.3f7c68cf-db76-4814-8f79-a6cf622975af" returned: 0 in 0.283s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Created reservations ['9e86f037-2833-4d3a-b2fa-d094eca03809', '2f9f3d4c-4d6e-4f68-82a9-d9ac73fd4295', 'b17b96fb-955a-4df4-bbde-6c3d34920973', '59c38830-6b72-4fc8-88e4-6c33f143c76d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:16 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.info Nov 06 21:27:16 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-quobyte-3f7c68cf-db76-4814-8f79-a6cf622975af" released by "_delete_snapshot" :: held 1.801s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-quobyte-d3139601-450c-48f1-a17c-8742263211d8" released by "delete_snapshot" :: held 1.827s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:16 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:16 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Created reservations ['8d33c384-2e9d-4901-bb7c-6f2063816153', '6860e29e-0c47-4569-a432-5c95a06dc9be', 'e3005d0c-f884-4784-9011-3f823f18e5ee', 'd4816e25-6463-437e-aeb5-99b0d19876a0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Delete snapshot completed successfully. Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6e951e72-c990-47e8-86de-bbdd7679af11 tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-3f7c68cf-db76-4814-8f79-a6cf622975af-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:16 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.info" returned: 0 in 0.333s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:16 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.info is being set with open permissions: ugo+rw Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:16 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.info Nov 06 21:27:16 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "cinder-d3139601-450c-48f1-a17c-8742263211d8-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:16 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-d3139601-450c-48f1-a17c-8742263211d8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.396s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Deleted volume successfully. Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40df5c81-6cb3-4b8c-9a54-44dcbea8f684 tempest-ProjectReaderTests-858085261 None] Lock "cinder-d04a5474-237f-4951-8951-2fc58a48d56d-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "cinder-quobyte-d3139601-450c-48f1-a17c-8742263211d8" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-quobyte-d3139601-450c-48f1-a17c-8742263211d8" acquired by "delete_volume" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:16 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.info" returned: 0 in 0.364s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e259560b-a9d4-4d52-8245-d92e3fa42d4c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.714s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0d2d2d-9df4-4618-9227-fdf92c73d08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be2e683e06a44f7b19fd89f8ab2f527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:12Z,use_quota=True,user_id='db0ccf9136be4ac0a8160b3ed65d78a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a84a6389-6af7-4bb0-8626-8c16f3128758),volume_type_id=a84a6389-6af7-4bb0-8626-8c16f3128758)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Creating volume be0d2d2d-9df4-4618-9227-fdf92c73d08e {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:16 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:16 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e 1073741824 Nov 06 21:27:16 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b1bf8c1d-ffd2-4a51-bbde-ae6f765bd942 tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Create snapshot completed successfully Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (d6123894-5d15-4681-9e49-800f48282673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465c91d2-6fc6-4803-a036-fe1a41503986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465c91d2-6fc6-4803-a036-fe1a41503986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93567297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5b4023-8435-416f-a9ed-d75f3b2d6819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:17Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b42fa57-8ef0-4968-b309-a717319f15a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b42fa57-8ef0-4968-b309-a717319f15a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe572b7-5b0b-47b6-a46c-bcf3ae360b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe572b7-5b0b-47b6-a46c-bcf3ae360b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5b4023-8435-416f-a9ed-d75f3b2d6819', 'volume_name': 'volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdc07d1-a3e8-4c93-9356-39645b8651ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdc07d1-a3e8-4c93-9356-39645b8651ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093c76e8-09b6-4476-b184-45678ba8df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Volume 2f5b4023-8435-416f-a9ed-d75f3b2d6819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819', 'volume_size': 1} Nov 06 21:27:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:17 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8" returned: 0 in 0.426s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e 1073741824" returned: 0 in 0.459s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8 Nov 06 21:27:17 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e Nov 06 21:27:17 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:17 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d3139601-450c-48f1-a17c-8742263211d8" returned: 0 in 0.273s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-quobyte-d3139601-450c-48f1-a17c-8742263211d8" released by "delete_volume" :: held 0.812s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:17 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93567297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5b4023-8435-416f-a9ed-d75f3b2d6819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b84165bc84e439e9c9ba258038d063c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:17Z,use_quota=True,user_id='33708e71cc81453a85fcc9acc4e19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Creating volume 2f5b4023-8435-416f-a9ed-d75f3b2d6819 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:17 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 1073741824 Nov 06 21:27:17 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Attempting download of 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'metadata': {}}])) to volume be0d2d2d-9df4-4618-9227-fdf92c73d08e. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Created reservations ['0f70a0ef-201f-45e8-bf61-3dfb49a4528a', '97fbccbb-59fd-4bbd-a9cb-560d9d961b81', 'f2f9a75e-6e03-493c-8013-a08c1e254efb', '0f64dff3-73f8-44fa-9b04-68ae8a38c7ff'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a60c08-f527-45cc-9b1c-b277890c7772]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_q6m74506 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:17 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:17 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_q6m74506 Nov 06 21:27:17 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "cinder-93cf3574-0059-433b-93d4-8e7bbd0d096c-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-93cf3574-0059-433b-93d4-8e7bbd0d096c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "cinder-quobyte-37385d84-a248-4bc5-a07b-ca62fbb70811" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:18 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-quobyte-37385d84-a248-4bc5-a07b-ca62fbb70811" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "cinder-quobyte-93cf3574-0059-433b-93d4-8e7bbd0d096c" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.396s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:18 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Deleted volume successfully. Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_q6m74506" returned: 0 in 0.489s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_q6m74506 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-quobyte-93cf3574-0059-433b-93d4-8e7bbd0d096c" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Deleting offline snapshot 93cf3574-0059-433b-93d4-8e7bbd0d096c of volume 37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:18 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] snapshot_file for this snap is: volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 1073741824" returned: 0 in 0.699s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b95c9f0-f675-4429-be1b-3fc8346cb56f tempest-VolumeSnapshotQuotasNegativeTestJSON-849861697 None] Lock "cinder-d3139601-450c-48f1-a17c-8742263211d8-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb8799-c132-462e-a968-caa1d681ab6b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_q6m74506 Nov 06 21:27:18 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 Nov 06 21:27:18 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c Nov 06 21:27:18 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_q6m74506" returned: 1 in 0.373s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_q6m74506' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[23607b68-c29a-47ad-9511-614f65527031]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819" returned: 0 in 0.283s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093c76e8-09b6-4476-b184-45678ba8df90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6a8af7-64b7-4353-bfec-59340ec695eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:18 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Volume volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 (2f5b4023-8435-416f-a9ed-d75f3b2d6819): created successfully Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6a8af7-64b7-4353-bfec-59340ec695eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Flow 'volume_create_manager' (d6123894-5d15-4681-9e49-800f48282673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f0fc64bf-fb68-4709-861b-1d45c29c6fb1 tempest-ProjectReaderTests-858085261 None] Created volume successfully. Nov 06 21:27:18 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD Nov 06 21:27:18 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c" returned: 0 in 0.441s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37385d84-a248-4bc5-a07b-ca62fbb70811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb8f37-2867-4222-b4f0-afa2d8390a4d]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 Nov 06 21:27:18 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-2f5b4023-8435-416f-a9ed-d75f3b2d6819-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Lock "cinder-2f5b4023-8435-416f-a9ed-d75f3b2d6819-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Acquiring lock "cinder-quobyte-2f5b4023-8435-416f-a9ed-d75f3b2d6819" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-2f5b4023-8435-416f-a9ed-d75f3b2d6819" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:19 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD Nov 06 21:27:19 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f5611a-4f7a-4bb9-a668-afbff4228203]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811" returned: 0 in 0.460s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c Nov 06 21:27:19 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 Nov 06 21:27:19 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD" returned: 1 in 0.545s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 was raw, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e Nov 06 21:27:19 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819" returned: 0 in 0.445s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819 Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c" returned: 0 in 0.425s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c Nov 06 21:27:19 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2f5b4023-8435-416f-a9ed-d75f3b2d6819" returned: 0 in 0.335s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Lock "cinder-quobyte-2f5b4023-8435-416f-a9ed-d75f3b2d6819" released by "delete_volume" :: held 0.865s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:20 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811.93cf3574-0059-433b-93d4-8e7bbd0d096c" returned: 0 in 0.345s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-quobyte-93cf3574-0059-433b-93d4-8e7bbd0d096c" released by "_delete_snapshot" :: held 1.847s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:20 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-quobyte-37385d84-a248-4bc5-a07b-ca62fbb70811" released by "delete_snapshot" :: held 1.918s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e" returned: 0 in 0.536s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2_0c8fwzlodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:20 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:20 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e 1G Nov 06 21:27:20 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Created reservations ['c96bbd03-1e66-44cb-bb8a-dd8a33afa1c0', '643815ee-fea8-4061-ba26-405299c3d271', '00dd9c9d-7a4e-4314-86b4-4ef357b7e800', 'b69b9b1b-284f-4f4d-b5bb-186ccef4e70c'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Created reservations ['2dfc2c51-a48e-40c4-ae16-5544f1f532f6', '845b0a32-79c1-4a2f-b81a-04a997814cd9', '8a91919e-180a-46f8-85a8-7c5e97747aef', 'c4fb991b-757b-470c-92f3-4f52efd5c4f7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:20 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:20 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Delete snapshot completed successfully. Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8c42dae2-ba06-4fbf-b657-4f07811943de tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-93cf3574-0059-433b-93d4-8e7bbd0d096c-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:20 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e 1G" returned: 0 in 0.422s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Downloaded image 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'metadata': {}}])) to volume be0d2d2d-9df4-4618-9227-fdf92c73d08e successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Temporary image 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 for user db0ccf9136be4ac0a8160b3ed65d78a6 is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Marking volume be0d2d2d-9df4-4618-9227-fdf92c73d08e as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Copying metadata from image 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 to be0d2d2d-9df4-4618-9227-fdf92c73d08e. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Creating volume glance metadata for volume be0d2d2d-9df4-4618-9227-fdf92c73d08e backed by image 0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '05d40c8162780c1cf54b63a38570b5ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eccf6e-e2e2-4f5f-a65d-78c18f5f1795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e', 'volume_size': 1, 'image_id': '0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05d40c8162780c1cf54b63a38570b5ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4be2e683e06a44f7b19fd89f8ab2f527', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03ee88aba613111d2c5945cdfe979bf6c9f22df48c347a02a46cfc2a83f8888e3ebd1091e52e405928f3d06b20a136fc525f746875fb7e672e92554aa5cceb15', 'id': '0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2', 'created_at': datetime.datetime(2026, 11, 6, 20, 27, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0378e49c-c0ae-47a6-8aa0-b850fc4a8fa2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30547881-c8dd-4a73-84e5-40740e04a084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:20 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Volume volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e (be0d2d2d-9df4-4618-9227-fdf92c73d08e): created successfully Nov 06 21:27:20 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30547881-c8dd-4a73-84e5-40740e04a084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Flow 'volume_create_manager' (8adb4511-6b23-465b-9b25-c1ca5bfa811e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.356s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f4dd59a1-6daa-40ce-ab22-720c49c34607 tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Created volume successfully. Nov 06 21:27:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Deleted volume successfully. Nov 06 21:27:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-dd947712-dce0-4042-a4a0-3fd8ac19c16c tempest-ProjectReaderTests-858085261 None] Lock "cinder-2f5b4023-8435-416f-a9ed-d75f3b2d6819-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "cinder-37385d84-a248-4bc5-a07b-ca62fbb70811-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-37385d84-a248-4bc5-a07b-ca62fbb70811-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "cinder-quobyte-37385d84-a248-4bc5-a07b-ca62fbb70811" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-quobyte-37385d84-a248-4bc5-a07b-ca62fbb70811" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1b6b37-d844-4f5f-a7c9-a0de46a7b7ba]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Acquiring lock "cinder-be0d2d2d-9df4-4618-9227-fdf92c73d08e-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "cinder-be0d2d2d-9df4-4618-9227-fdf92c73d08e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:21 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 Nov 06 21:27:21 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Acquiring lock "cinder-quobyte-be0d2d2d-9df4-4618-9227-fdf92c73d08e" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "cinder-quobyte-be0d2d2d-9df4-4618-9227-fdf92c73d08e" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7425d7-3917-4180-ae5c-15c4a4ff6e28]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:22 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e Nov 06 21:27:22 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:22 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811" returned: 0 in 0.509s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:22 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811 Nov 06 21:27:22 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:22 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e" returned: 0 in 0.479s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:22 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e Nov 06 21:27:22 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:22 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37385d84-a248-4bc5-a07b-ca62fbb70811" returned: 0 in 0.328s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-quobyte-37385d84-a248-4bc5-a07b-ca62fbb70811" released by "delete_volume" :: held 0.942s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Created reservations ['bf6f0107-162c-4da3-a3c8-22992d569934', 'd7c1f409-fe5d-46f0-90b9-101a5378295a', 'b0291dad-2b01-4f2d-a2d4-6cbd90064001', '42045296-da3a-4b1a-a819-db2e0d29a03f'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:22 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:22 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:22 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be0d2d2d-9df4-4618-9227-fdf92c73d08e" returned: 0 in 0.393s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "cinder-quobyte-be0d2d2d-9df4-4618-9227-fdf92c73d08e" released by "delete_volume" :: held 0.947s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:22 devstack cinder-volume[87450]: WARNING cinder.quota [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:27:22 devstack cinder-volume[87450]: WARNING cinder.quota [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:27:22 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Created reservations ['3a58d7cf-d4c7-41a9-890f-d460af94f48a', '17578e68-fe0f-4357-9cd0-448bc6581aa2', '0ce4cdd4-ec31-46bf-af73-aef5ff2e6e04', '20c546c2-32ec-4ca3-92a9-cd2f6e4ec755'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:23 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:23 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Deleted volume successfully. Nov 06 21:27:23 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d73994a-a42d-4fb0-b741-aa537f7cab7c tempest-VolumesSnapshotNegativeTestJSON-1622839364 None] Lock "cinder-37385d84-a248-4bc5-a07b-ca62fbb70811-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:23 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.352s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Deleted volume successfully. Nov 06 21:27:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-89e08f1d-6429-41e4-8675-ab49268b19fe tempest-VolumeAndVolumeTypeFromImageTest-1471623707 None] Lock "cinder-be0d2d2d-9df4-4618-9227-fdf92c73d08e-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=167,cinder:INSERT=63,cinder:UPDATE=205,cinder:DELETE=15 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (1a5af7fd-0e35-4f63-bd35-b08d5c036717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ecc0b0-8f8c-43b3-bcb6-9bdd1624f7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ecc0b0-8f8c-43b3-bcb6-9bdd1624f7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304613319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e9a0b8-457a-4f53-964e-56096e7a0bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:33Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9e819b-2042-4938-9393-f1f0f8ee0699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9e819b-2042-4938-9393-f1f0f8ee0699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7678a181-7103-4131-b272-f78b8305c8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7678a181-7103-4131-b272-f78b8305c8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e9a0b8-457a-4f53-964e-56096e7a0bb7', 'volume_name': 'volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c3af39-790f-4141-8e30-d51b376c697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c3af39-790f-4141-8e30-d51b376c697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84525c66-7153-4eb0-b9c3-8774b3156d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume 49e9a0b8-457a-4f53-964e-56096e7a0bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7', 'volume_size': 1} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304613319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e9a0b8-457a-4f53-964e-56096e7a0bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:33Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Creating volume 49e9a0b8-457a-4f53-964e-56096e7a0bb7 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:32 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:33 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 1073741824 Nov 06 21:27:33 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:33 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 1073741824" returned: 0 in 0.568s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:33 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 Nov 06 21:27:33 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:33 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7" returned: 0 in 0.367s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84525c66-7153-4eb0-b9c3-8774b3156d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabd5f97-473c-4f37-a997-7c68fa19b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 (49e9a0b8-457a-4f53-964e-56096e7a0bb7): created successfully Nov 06 21:27:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabd5f97-473c-4f37-a997-7c68fa19b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (1a5af7fd-0e35-4f63-bd35-b08d5c036717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-325b2ab1-d96e-4e22-801a-a9fd2c40a60c tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created volume successfully. Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (2473321b-b8a4-485a-855d-c39fab3e5fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4ff6b6-e221-4fd6-af80-0df2b2e433fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4ff6b6-e221-4fd6-af80-0df2b2e433fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113756131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85a0ff9-7ed5-4663-986d-dbd44e125389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:35Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f747fb4-1fba-460f-9d44-15300e4c1b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f747fb4-1fba-460f-9d44-15300e4c1b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d789fbb-2cb4-4530-9609-0ee0f9b9b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d789fbb-2cb4-4530-9609-0ee0f9b9b14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85a0ff9-7ed5-4663-986d-dbd44e125389', 'volume_name': 'volume-e85a0ff9-7ed5-4663-986d-dbd44e125389', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c440f94-e407-481a-ba83-1c714f497a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c440f94-e407-481a-ba83-1c714f497a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cfa1a3-d5b0-47b2-8d73-ea3ffb95a5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume e85a0ff9-7ed5-4663-986d-dbd44e125389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85a0ff9-7ed5-4663-986d-dbd44e125389', 'volume_size': 1} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113756131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85a0ff9-7ed5-4663-986d-dbd44e125389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:35Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Creating volume e85a0ff9-7ed5-4663-986d-dbd44e125389 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:35 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:35 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 1073741824 Nov 06 21:27:35 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (a78f7fad-1f77-4d07-9966-682cffea5515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97a3914-ef38-450b-826c-cfa2599d6cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97a3914-ef38-450b-826c-cfa2599d6cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531924622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d749a902-8e7f-4e1b-845e-1aea60555095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:36Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a733c0-ece4-4b1c-9d3b-043c7e1a8831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a733c0-ece4-4b1c-9d3b-043c7e1a8831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ef9004-5ae9-491c-8e78-e57f83ae4aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ef9004-5ae9-491c-8e78-e57f83ae4aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd749a902-8e7f-4e1b-845e-1aea60555095', 'volume_name': 'volume-d749a902-8e7f-4e1b-845e-1aea60555095', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500340f9-d7c9-4286-80f1-08b4d8fe782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500340f9-d7c9-4286-80f1-08b4d8fe782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391dbe6e-f461-4ec4-9eb0-e8627e2c1b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume d749a902-8e7f-4e1b-845e-1aea60555095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d749a902-8e7f-4e1b-845e-1aea60555095', 'volume_size': 1} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:36 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 1073741824" returned: 0 in 0.808s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:36 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 Nov 06 21:27:36 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (50ed58f6-6847-4905-abcf-7f89bbfca680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0bad84-fce3-43fc-ad85-bb57d98e8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0bad84-fce3-43fc-ad85-bb57d98e8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369466753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80199a9a-0d47-4950-a95d-339baa24dc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:37Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6254644d-aa3f-4b4e-bc39-b00ad8631074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6254644d-aa3f-4b4e-bc39-b00ad8631074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5000ad2-0384-4067-9665-9ceb8c8d1f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5000ad2-0384-4067-9665-9ceb8c8d1f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80199a9a-0d47-4950-a95d-339baa24dc9d', 'volume_name': 'volume-80199a9a-0d47-4950-a95d-339baa24dc9d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01054333-8495-4cee-bdb8-5920c58a21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01054333-8495-4cee-bdb8-5920c58a21cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9527fbb-3baf-4720-99ae-f43ed5507b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume 80199a9a-0d47-4950-a95d-339baa24dc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80199a9a-0d47-4950-a95d-339baa24dc9d', 'volume_size': 1} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:36 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389" returned: 0 in 0.463s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531924622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d749a902-8e7f-4e1b-845e-1aea60555095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:36Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Creating volume d749a902-8e7f-4e1b-845e-1aea60555095 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:37 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cfa1a3-d5b0-47b2-8d73-ea3ffb95a5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85a0ff9-7ed5-4663-986d-dbd44e125389', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1754ae7e-b02b-4bc4-8674-06bb598ef3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 1073741824 Nov 06 21:27:37 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 (e85a0ff9-7ed5-4663-986d-dbd44e125389): created successfully Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1754ae7e-b02b-4bc4-8674-06bb598ef3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (2473321b-b8a4-485a-855d-c39fab3e5fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-14d9ef8a-7716-42cb-a826-8a4795bcc1f6 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created volume successfully. Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (e4cb59d9-4d1e-4729-b141-4ca13a6592ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105bcacf-5f54-438f-9d8b-8bba5a83a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105bcacf-5f54-438f-9d8b-8bba5a83a718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969488978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91083b8-7e09-4824-b34d-f0e4ee6fad28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:37Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c483f56-7bd6-45e0-95c4-fae8b71f6c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c483f56-7bd6-45e0-95c4-fae8b71f6c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b279b2e-aae9-43f4-b5f8-1ce6ff436239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b279b2e-aae9-43f4-b5f8-1ce6ff436239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f91083b8-7e09-4824-b34d-f0e4ee6fad28', 'volume_name': 'volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e31fb-ea18-4ed5-8a3b-408aeb6b2961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e31fb-ea18-4ed5-8a3b-408aeb6b2961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408cfbb8-48da-4ac1-9040-6fac26352606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume f91083b8-7e09-4824-b34d-f0e4ee6fad28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28', 'volume_size': 1} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (809f06f3-dd2f-4a4c-a2d5-9907f049c582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c0a6db-a00a-47b7-b1e9-98a7fa67f887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c0a6db-a00a-47b7-b1e9-98a7fa67f887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988415223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0117fd-7792-46c4-9b4c-59a6f208bbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:38Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218b2583-0d51-4c85-a179-fc35dc696808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218b2583-0d51-4c85-a179-fc35dc696808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d4c446-7e93-4e6a-97c9-e3417a6b6138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d4c446-7e93-4e6a-97c9-e3417a6b6138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0117fd-7792-46c4-9b4c-59a6f208bbd4', 'volume_name': 'volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d3b597-1b10-451a-9c73-59e8db148ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d3b597-1b10-451a-9c73-59e8db148ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2b4b3d-517b-412f-8197-ef987bebe9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume 1d0117fd-7792-46c4-9b4c-59a6f208bbd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4', 'volume_size': 1} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:37 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 1073741824" returned: 0 in 0.906s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:37 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 Nov 06 21:27:37 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:38 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369466753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80199a9a-0d47-4950-a95d-339baa24dc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:37Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Creating volume 80199a9a-0d47-4950-a95d-339baa24dc9d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:38 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391dbe6e-f461-4ec4-9eb0-e8627e2c1b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d749a902-8e7f-4e1b-845e-1aea60555095', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9865a15b-5283-4651-b96b-326049798c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:38 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d 1073741824 Nov 06 21:27:38 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume volume-d749a902-8e7f-4e1b-845e-1aea60555095 (d749a902-8e7f-4e1b-845e-1aea60555095): created successfully Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9865a15b-5283-4651-b96b-326049798c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (a78f7fad-1f77-4d07-9966-682cffea5515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-912713c4-a5cd-49bf-b32d-9f7f309d93ca tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created volume successfully. Nov 06 21:27:38 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d 1073741824" returned: 0 in 0.704s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:39 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d Nov 06 21:27:39 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:39 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d" returned: 0 in 0.276s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969488978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91083b8-7e09-4824-b34d-f0e4ee6fad28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:37Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Creating volume f91083b8-7e09-4824-b34d-f0e4ee6fad28 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:39 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9527fbb-3baf-4720-99ae-f43ed5507b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80199a9a-0d47-4950-a95d-339baa24dc9d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af93901-b786-4582-8d8b-14aa901aca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:39 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 1073741824 Nov 06 21:27:39 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume volume-80199a9a-0d47-4950-a95d-339baa24dc9d (80199a9a-0d47-4950-a95d-339baa24dc9d): created successfully Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af93901-b786-4582-8d8b-14aa901aca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (50ed58f6-6847-4905-abcf-7f89bbfca680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:39 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2a572e7c-5787-431a-85d2-5871923af7e3 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created volume successfully. Nov 06 21:27:39 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 1073741824" returned: 0 in 0.621s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 Nov 06 21:27:40 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:40 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28" returned: 0 in 0.319s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.433s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988415223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0117fd-7792-46c4-9b4c-59a6f208bbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8893046f9c44bb3ab8ae619fac05219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:38Z,use_quota=True,user_id='21fbd9cc3cdb4aa986c06ffbae67dc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Creating volume 1d0117fd-7792-46c4-9b4c-59a6f208bbd4 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:40 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408cfbb8-48da-4ac1-9040-6fac26352606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1418f2-0fba-4e33-9831-dbd5a6100292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:40 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 1073741824 Nov 06 21:27:40 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 (f91083b8-7e09-4824-b34d-f0e4ee6fad28): created successfully Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1418f2-0fba-4e33-9831-dbd5a6100292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (e4cb59d9-4d1e-4729-b141-4ca13a6592ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c0d94994-f0a4-4f73-b32b-2869f3c4d2ad tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created volume successfully. Nov 06 21:27:40 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 1073741824" returned: 0 in 0.537s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 Nov 06 21:27:40 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:41 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4" returned: 0 in 0.301s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2b4b3d-517b-412f-8197-ef987bebe9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680e8f4c-9edb-4c4b-8131-16069d609609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:41 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Volume volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 (1d0117fd-7792-46c4-9b4c-59a6f208bbd4): created successfully Nov 06 21:27:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680e8f4c-9edb-4c4b-8131-16069d609609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Flow 'volume_create_manager' (809f06f3-dd2f-4a4c-a2d5-9907f049c582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b98a3b04-5d9e-465f-b6b9-8006ee772874 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created volume successfully. Nov 06 21:27:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-1d0117fd-7792-46c4-9b4c-59a6f208bbd4-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-1d0117fd-7792-46c4-9b4c-59a6f208bbd4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-quobyte-1d0117fd-7792-46c4-9b4c-59a6f208bbd4" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-1d0117fd-7792-46c4-9b4c-59a6f208bbd4" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c8034-b655-4320-9f60-ca974fed57a2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:42 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 Nov 06 21:27:42 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:43 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4" returned: 0 in 0.462s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:43 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4 Nov 06 21:27:43 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:43 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1d0117fd-7792-46c4-9b4c-59a6f208bbd4" returned: 0 in 0.313s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-1d0117fd-7792-46c4-9b4c-59a6f208bbd4" released by "delete_volume" :: held 0.849s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created reservations ['99227ad6-9dcf-42f8-9212-357ced1441d6', '3c70a436-469d-4a05-afae-1d559dee62bc', '2112d6f9-9760-4c55-ace7-17c713185c1f', '3d7cd5fe-f691-466a-be6a-586b956c8fc6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:43 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:43 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-f91083b8-7e09-4824-b34d-f0e4ee6fad28-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-f91083b8-7e09-4824-b34d-f0e4ee6fad28-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-quobyte-f91083b8-7e09-4824-b34d-f0e4ee6fad28" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-f91083b8-7e09-4824-b34d-f0e4ee6fad28" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a62ff8-1fff-4264-a193-26dcb1c2a418]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:44 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.402s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Deleted volume successfully. Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-051bd2b0-cc38-4348-9ad6-e40cc3ccb579 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-1d0117fd-7792-46c4-9b4c-59a6f208bbd4-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:44 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 Nov 06 21:27:44 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:44 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28" returned: 0 in 0.497s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:44 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28 Nov 06 21:27:44 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:44 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f91083b8-7e09-4824-b34d-f0e4ee6fad28" returned: 0 in 0.311s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-f91083b8-7e09-4824-b34d-f0e4ee6fad28" released by "delete_volume" :: held 0.878s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created reservations ['19a00707-29ed-4603-9e65-817f56546096', '536f5a79-4249-4ef1-8e4c-0959e80e7293', '6b2dd3f7-9327-4eea-ac24-6389c8820801', '2ac7d4b2-0426-438a-b4ac-d76aabbb20a0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:44 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:44 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:45 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:45 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Deleted volume successfully. Nov 06 21:27:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2edf3803-32ed-4867-98c2-37d8bba708cb tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-f91083b8-7e09-4824-b34d-f0e4ee6fad28-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-80199a9a-0d47-4950-a95d-339baa24dc9d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-80199a9a-0d47-4950-a95d-339baa24dc9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-quobyte-80199a9a-0d47-4950-a95d-339baa24dc9d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-80199a9a-0d47-4950-a95d-339baa24dc9d" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f09cdf-7c1c-46f6-9e90-5718e6406473]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:46 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d Nov 06 21:27:46 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:46 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d" returned: 0 in 0.472s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:46 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d Nov 06 21:27:46 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:46 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-80199a9a-0d47-4950-a95d-339baa24dc9d" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-80199a9a-0d47-4950-a95d-339baa24dc9d" released by "delete_volume" :: held 0.886s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created reservations ['548f4883-7fea-4b1b-bbdf-1943b4a7e824', 'e4fc7283-730d-40a6-9b06-ded18732054f', 'e3c18f93-b5aa-4dd1-a2f0-53fb4a2bdda3', '2096b429-0c8b-4ed7-9eeb-d8a5babd1ce6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:47 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:47 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-d749a902-8e7f-4e1b-845e-1aea60555095-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-d749a902-8e7f-4e1b-845e-1aea60555095-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-quobyte-d749a902-8e7f-4e1b-845e-1aea60555095" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-d749a902-8e7f-4e1b-845e-1aea60555095" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e78e8d-5852-4413-b792-1ad526e1aa1f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:47 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.505s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Deleted volume successfully. Nov 06 21:27:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1025a395-4556-4d50-b0a8-cdc9775e2ed1 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-80199a9a-0d47-4950-a95d-339baa24dc9d-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:47 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 Nov 06 21:27:47 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:48 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095" returned: 0 in 0.599s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:48 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095 Nov 06 21:27:48 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:48 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d749a902-8e7f-4e1b-845e-1aea60555095" returned: 0 in 0.408s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-d749a902-8e7f-4e1b-845e-1aea60555095" released by "delete_volume" :: held 1.121s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created reservations ['d5a88eae-77a8-4d97-834a-5eb357874efd', 'dc48927e-90ee-4856-af7f-205cea1a07b9', 'cc6b10ed-e588-489d-82d1-70e2cf6d4924', 'bdce9c97-1684-4c6d-a6e1-64f48fd14777'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:48 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:48 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:49 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:49 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:49 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Deleted volume successfully. Nov 06 21:27:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8a44a5ae-2e59-4f68-8e8b-3fd5401d97ed tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-d749a902-8e7f-4e1b-845e-1aea60555095-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-e85a0ff9-7ed5-4663-986d-dbd44e125389-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-e85a0ff9-7ed5-4663-986d-dbd44e125389-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-quobyte-e85a0ff9-7ed5-4663-986d-dbd44e125389" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-e85a0ff9-7ed5-4663-986d-dbd44e125389" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1122728c-491d-4f6a-b644-6d168b54e3fc]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:50 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 Nov 06 21:27:50 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:50 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389" returned: 0 in 0.478s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:50 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389 Nov 06 21:27:50 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:50 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e85a0ff9-7ed5-4663-986d-dbd44e125389" returned: 0 in 0.290s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-e85a0ff9-7ed5-4663-986d-dbd44e125389" released by "delete_volume" :: held 0.840s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created reservations ['82c736cd-e08b-4c30-8de7-c672901dcb4f', '94f6f8f5-a541-4fe7-a964-a576147abf07', '3478f69b-730b-484b-b19a-759a94a13632', 'a1d9f140-ca0a-498f-8eda-f0e1224112a5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:51 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:51 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-49e9a0b8-457a-4f53-964e-56096e7a0bb7-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-49e9a0b8-457a-4f53-964e-56096e7a0bb7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "cinder-quobyte-49e9a0b8-457a-4f53-964e-56096e7a0bb7" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-49e9a0b8-457a-4f53-964e-56096e7a0bb7" acquired by "delete_volume" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[166cb8fc-ec4e-4989-b49e-b9db8bc9bc96]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:51 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.383s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Deleted volume successfully. Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cebcc583-89d9-4034-8890-b294d76a2168 tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-e85a0ff9-7ed5-4663-986d-dbd44e125389-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:51 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 Nov 06 21:27:51 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:51 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7" returned: 0 in 0.538s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:51 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7 Nov 06 21:27:51 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:52 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-49e9a0b8-457a-4f53-964e-56096e7a0bb7" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-quobyte-49e9a0b8-457a-4f53-964e-56096e7a0bb7" released by "delete_volume" :: held 0.932s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Created reservations ['0012ad5b-038c-4b2c-8dad-f39dc9784002', 'c6a987c9-15c4-4d04-9575-c31fa1c1fd2a', '7f45c4b7-322d-4915-8532-1d2a2b235300', 'bdb6a158-4b6a-4d22-aab4-c6225decb1ee'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:52 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:27:52 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:52 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.311s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Deleted volume successfully. Nov 06 21:27:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-20b76201-b1b5-4834-85e4-2609f3d0989b tempest-CreateVolumesFromSourceVolumeTest-2005321536 None] Lock "cinder-49e9a0b8-457a-4f53-964e-56096e7a0bb7-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:59 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:27:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Flow 'volume_create_manager' (57459444-00fd-46b7-aef0-514d21ac5b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa13aaf-4584-4f95-b1f4-603b67979ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa13aaf-4584-4f95-b1f4-603b67979ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1808783029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd92d66-6f08-4703-a583-92385a05310e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ab948022ad4e07b6f60256cbc23ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:00Z,use_quota=True,user_id='7138a5d5c4424f4c91a944dd1181402f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba1e545-a906-4918-9137-4627782a35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba1e545-a906-4918-9137-4627782a35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a382ca6d-19ce-4f64-860e-1ad4f1fe140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a382ca6d-19ce-4f64-860e-1ad4f1fe140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd92d66-6f08-4703-a583-92385a05310e', 'volume_name': 'volume-ddd92d66-6f08-4703-a583-92385a05310e', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14f59a8-cc4a-4ba4-873a-cddaa61f53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14f59a8-cc4a-4ba4-873a-cddaa61f53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482ca06c-0b66-4252-90ad-54be6636b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Volume ddd92d66-6f08-4703-a583-92385a05310e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd92d66-6f08-4703-a583-92385a05310e', 'volume_size': 1} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1808783029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd92d66-6f08-4703-a583-92385a05310e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ab948022ad4e07b6f60256cbc23ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:00Z,use_quota=True,user_id='7138a5d5c4424f4c91a944dd1181402f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Creating volume ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:00 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:00 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e 1073741824 Nov 06 21:28:00 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:01 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e 1073741824" returned: 0 in 1.122s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:01 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e Nov 06 21:28:01 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:01 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e" returned: 0 in 0.515s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482ca06c-0b66-4252-90ad-54be6636b30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd92d66-6f08-4703-a583-92385a05310e', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b7f4de-d53a-42d5-8a09-ba2f8305639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:01 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Volume volume-ddd92d66-6f08-4703-a583-92385a05310e (ddd92d66-6f08-4703-a583-92385a05310e): created successfully Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b7f4de-d53a-42d5-8a09-ba2f8305639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Flow 'volume_create_manager' (57459444-00fd-46b7-aef0-514d21ac5b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:01 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f74ec93a-f59e-4e74-b94c-5b814c2d1780 tempest-VolumeDependencyTests-2021270555 None] Created volume successfully. Nov 06 21:28:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Creating offline snapshot 4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 of volume ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:28:03 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a4d57-1fd0-48e2-9adc-129d67483adc]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:03 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e Nov 06 21:28:03 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:04 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e" returned: 0 in 0.570s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:04 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 1G Nov 06 21:28:04 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (d0d17729-ff21-41ea-8a6a-268ee075e556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea9ee19-d214-4a8f-9ae3-073a9b8d7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea9ee19-d214-4a8f-9ae3-073a9b8d7e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578343139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b0c0dd-3e8d-406a-b8da-afe428c779ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:04Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9d46cd-5ef6-46db-a61c-7eb03af703ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9d46cd-5ef6-46db-a61c-7eb03af703ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78b2b66-8b64-45ad-b46a-9d311dc93f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78b2b66-8b64-45ad-b46a-9d311dc93f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b0c0dd-3e8d-406a-b8da-afe428c779ac', 'volume_name': 'volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6179dc-d576-4aa0-a084-764242a85788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6179dc-d576-4aa0-a084-764242a85788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f36ca6-a6aa-42ba-8724-57fa4a242706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:04 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Volume 03b0c0dd-3e8d-406a-b8da-afe428c779ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac', 'volume_size': 1} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:04 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 1G" returned: 0 in 0.584s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd92d66-6f08-4703-a583-92385a05310e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:04 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd92d66-6f08-4703-a583-92385a05310e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 Nov 06 21:28:04 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:05 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd92d66-6f08-4703-a583-92385a05310e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" returned: 0 in 0.381s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:05 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 is being set with open permissions: ugo+rw Nov 06 21:28:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:05 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 Nov 06 21:28:05 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:05 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" returned: 0 in 0.303s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:05 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.info Nov 06 21:28:05 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:05 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.info" returned: 0 in 0.293s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:05 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.info is being set with open permissions: ugo+rw Nov 06 21:28:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:05 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.info Nov 06 21:28:05 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:06 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.info" returned: 0 in 0.270s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578343139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b0c0dd-3e8d-406a-b8da-afe428c779ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:04Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Creating volume 03b0c0dd-3e8d-406a-b8da-afe428c779ac {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:06 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:06 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac 1073741824 Nov 06 21:28:06 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:06 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6c01fa28-0bf2-4ed7-8e5f-e918f6460521 tempest-VolumeDependencyTests-2021270555 None] Create snapshot completed successfully Nov 06 21:28:07 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac 1073741824" returned: 0 in 0.849s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:07 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac Nov 06 21:28:07 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:07 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac" returned: 0 in 0.485s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f36ca6-a6aa-42ba-8724-57fa4a242706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1898b5ea-458d-46be-8359-c4f3a9ccabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Volume volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac (03b0c0dd-3e8d-406a-b8da-afe428c779ac): created successfully Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1898b5ea-458d-46be-8359-c4f3a9ccabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (d0d17729-ff21-41ea-8a6a-268ee075e556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-81b4676a-6a8c-46da-b2b0-aea80a1c5589 tempest-VolumesActionsTest-1900086108 None] Created volume successfully. Nov 06 21:28:07 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Flow 'volume_create_manager' (e1c1adae-019d-4859-8095-602a4c1a464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d613cee3-478a-4ec3-84fb-c7525c7510b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d613cee3-478a-4ec3-84fb-c7525c7510b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-403857020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be53b2d2-331d-454e-9204-d70b8a55d37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ab948022ad4e07b6f60256cbc23ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4d636cfb-8807-4e7d-9e17-bdc3a2ec5367,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:08Z,use_quota=True,user_id='7138a5d5c4424f4c91a944dd1181402f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa6a7d6-8b8c-4138-912b-4b121fee5f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa6a7d6-8b8c-4138-912b-4b121fee5f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773672ea-6a30-4aa2-88e3-e6c4b3a56013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773672ea-6a30-4aa2-88e3-e6c4b3a56013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be53b2d2-331d-454e-9204-d70b8a55d37b', 'volume_name': 'volume-be53b2d2-331d-454e-9204-d70b8a55d37b', 'volume_size': 1, 'snapshot_id': '4d636cfb-8807-4e7d-9e17-bdc3a2ec5367'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e760c8-5a16-4349-96d2-37ad9a351fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e760c8-5a16-4349-96d2-37ad9a351fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062c7255-d51b-45b6-9ab3-95f1c03da028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:08 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Volume be53b2d2-331d-454e-9204-d70b8a55d37b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be53b2d2-331d-454e-9204-d70b8a55d37b', 'volume_size': 1, 'snapshot_id': '4d636cfb-8807-4e7d-9e17-bdc3a2ec5367'} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-quobyte-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367-be53b2d2-331d-454e-9204-d70b8a55d37b" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367-be53b2d2-331d-454e-9204-d70b8a55d37b" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Creating volume be53b2d2-331d-454e-9204-d70b8a55d37b from snapshot 4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-quobyte-be53b2d2-331d-454e-9204-d70b8a55d37b" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-be53b2d2-331d-454e-9204-d70b8a55d37b" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] snapshot: 4d636cfb-8807-4e7d-9e17-bdc3a2ec5367, volume: be53b2d2-331d-454e-9204-d70b8a55d37b, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1868392-a749-4e4c-ba03-ca52b880039f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:08 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 Nov 06 21:28:08 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b5cce1d-5baf-447a-8b78-c81dc76672d6 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac" by "attach_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b5cce1d-5baf-447a-8b78-c81dc76672d6 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac" acquired by "attach_volume" :: waited 0.048s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8b5cce1d-5baf-447a-8b78-c81dc76672d6 tempest-VolumesActionsTest-1900086108 None] Attaching volume 03b0c0dd-3e8d-406a-b8da-afe428c779ac to instance a25567ca-0b2a-428a-90b3-11e41c3089f2 at mountpoint /dev/vdb on host None. Nov 06 21:28:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8b5cce1d-5baf-447a-8b78-c81dc76672d6 tempest-VolumesActionsTest-1900086108 None] Attach volume completed successfully. Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-8b5cce1d-5baf-447a-8b78-c81dc76672d6 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac" released by "attach_volume" :: held 0.197s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:09 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" returned: 0 in 0.656s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd92d66-6f08-4703-a583-92385a05310e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8735d86f-c5cf-4a56-8651-660403122dba]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:09 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e Nov 06 21:28:09 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:09 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e" returned: 0 in 0.792s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:28:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:10 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b Nov 06 21:28:10 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7351b20f-9c6d-4602-9197-8652c24aef7a tempest-VolumesActionsTest-2132467548 None] Terminate volume connection completed successfully. Nov 06 21:28:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7351b20f-9c6d-4602-9197-8652c24aef7a tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-detach_volume" by "detach_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7351b20f-9c6d-4602-9197-8652c24aef7a tempest-VolumesActionsTest-2132467548 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7351b20f-9c6d-4602-9197-8652c24aef7a tempest-VolumesActionsTest-2132467548 None] Detaching volume 03b0c0dd-3e8d-406a-b8da-afe428c779ac from instance a25567ca-0b2a-428a-90b3-11e41c3089f2. Nov 06 21:28:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7351b20f-9c6d-4602-9197-8652c24aef7a tempest-VolumesActionsTest-2132467548 None] Detach volume completed successfully. Nov 06 21:28:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7351b20f-9c6d-4602-9197-8652c24aef7a tempest-VolumesActionsTest-2132467548 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-02164fe8-d35a-48cc-925f-770f0d155898 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-detach_volume" by "detach_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-02164fe8-d35a-48cc-925f-770f0d155898 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-02164fe8-d35a-48cc-925f-770f0d155898 tempest-VolumesActionsTest-1900086108 None] Volume detach called, but volume not attached. Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-02164fe8-d35a-48cc-925f-770f0d155898 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:11 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:11 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "cinder-quobyte-03b0c0dd-3e8d-406a-b8da-afe428c779ac" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-quobyte-03b0c0dd-3e8d-406a-b8da-afe428c779ac" acquired by "delete_volume" :: waited 0.040s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:12 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 1.070s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d85f461-e91d-4914-92b9-dadd99efaf98]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:12 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac Nov 06 21:28:12 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:14 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac" returned: 0 in 1.862s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:14 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac Nov 06 21:28:14 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:15 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-03b0c0dd-3e8d-406a-b8da-afe428c779ac" returned: 0 in 1.098s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-quobyte-03b0c0dd-3e8d-406a-b8da-afe428c779ac" released by "delete_volume" :: held 3.196s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=99,cinder:UPDATE=151,cinder:DELETE=13,cinder:INSERT=40 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Created reservations ['8d874be2-1286-419e-8f0b-dfbf2caab950', '89446c92-1b23-4ee2-a8a1-db1fe2909e60', 'fc0822b5-ef83-4b95-855d-756f9102411d', 'c095242b-cfae-42b1-a405-a871cdba38a6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:15 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:15 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:16 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.763s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:16 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Deleted volume successfully. Nov 06 21:28:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba0bc88a-0392-4e6c-aeee-3dd21fe44e99 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-03b0c0dd-3e8d-406a-b8da-afe428c779ac-delete_volume" released by "delete_volume" :: held 4.950s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Flow 'volume_create_manager' (a26fa225-a3a4-496e-bed9-c7fb15a04a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75139aa4-d5d5-4118-9b3c-054165aa9e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75139aa4-d5d5-4118-9b3c-054165aa9e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-351790367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1753b6-ef2d-4875-852d-0dbf8e3233f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e7c2e9672846acb48dfdfc4af4e822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:23Z,use_quota=True,user_id='7beb92e143cb43408ce146bed7a055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2eb099-f204-404d-9aed-63bdeff6ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2eb099-f204-404d-9aed-63bdeff6ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5baf4a3-4ff8-401e-bb15-073d71306b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5baf4a3-4ff8-401e-bb15-073d71306b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da1753b6-ef2d-4875-852d-0dbf8e3233f6', 'volume_name': 'volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fde6f8a-64ed-474e-aeab-8164df6a4b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fde6f8a-64ed-474e-aeab-8164df6a4b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047fcc6c-074a-4124-92ff-71defc6143ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Volume da1753b6-ef2d-4875-852d-0dbf8e3233f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6', 'volume_size': 1} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:23 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b" returned: 0 in 13.611s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e, size 1024.00 MB, duration 13.61 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:28:23 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Converted 1024.00 MB image at 75.23 MB/s Nov 06 21:28:23 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b is being set with open permissions: ugo+rw Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:23 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b Nov 06 21:28:23 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:23 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-be53b2d2-331d-454e-9204-d70b8a55d37b" released by "_copy_volume_from_snapshot" :: held 15.469s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367-be53b2d2-331d-454e-9204-d70b8a55d37b" released by "_create_volume_from_snapshot" :: held 15.584s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.617s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-351790367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1753b6-ef2d-4875-852d-0dbf8e3233f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e7c2e9672846acb48dfdfc4af4e822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:23Z,use_quota=True,user_id='7beb92e143cb43408ce146bed7a055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Creating volume da1753b6-ef2d-4875-852d-0dbf8e3233f6 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:23 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:23 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 1073741824 Nov 06 21:28:23 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062c7255-d51b-45b6-9ab3-95f1c03da028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be53b2d2-331d-454e-9204-d70b8a55d37b', 'volume_size': 1, 'snapshot_id': '4d636cfb-8807-4e7d-9e17-bdc3a2ec5367'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807ec900-ccf3-46fe-9b2b-1f88ee6c944d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Volume volume-be53b2d2-331d-454e-9204-d70b8a55d37b (be53b2d2-331d-454e-9204-d70b8a55d37b): created successfully Nov 06 21:28:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807ec900-ccf3-46fe-9b2b-1f88ee6c944d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Flow 'volume_create_manager' (e1c1adae-019d-4859-8095-602a4c1a464d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ba21b145-fe20-4019-b8e1-635b31e176ca tempest-VolumeDependencyTests-2021270555 None] Created volume successfully. Nov 06 21:28:24 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 1073741824" returned: 0 in 0.517s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:24 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 Nov 06 21:28:24 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-quobyte-ddd92d66-6f08-4703-a583-92385a05310e" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-ddd92d66-6f08-4703-a583-92385a05310e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-quobyte-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Deleting offline snapshot 4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 of volume ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] snapshot_file for this snap is: volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:28:24 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaacc4bc-d949-4a8a-9966-c8497a159a93]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047fcc6c-074a-4124-92ff-71defc6143ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67e6108-5569-48c8-b5f1-6b8b1d9000eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Volume volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 (da1753b6-ef2d-4875-852d-0dbf8e3233f6): created successfully Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67e6108-5569-48c8-b5f1-6b8b1d9000eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Flow 'volume_create_manager' (a26fa225-a3a4-496e-bed9-c7fb15a04a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-39e7ac02-95ac-4a56-9af0-530fd20ac4d6 tempest-TestMinimumBasicScenario-1644048841 None] Created volume successfully. Nov 06 21:28:24 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 Nov 06 21:28:24 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:25 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" returned: 0 in 0.490s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd92d66-6f08-4703-a583-92385a05310e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a858571-ac51-460b-821b-1bf01a74d49b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (602a77de-8dfd-4ba7-b334-fba6a365f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02b65f3-dfe1-48b7-a1a5-8e4323741bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02b65f3-dfe1-48b7-a1a5-8e4323741bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-8148708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de79305a-e8fc-4e8e-b549-2f450d1178aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:25Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af865d9d-13b8-43e1-8982-1665f3254c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af865d9d-13b8-43e1-8982-1665f3254c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fe64fd-1941-4717-a595-e3337c1950de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fe64fd-1941-4717-a595-e3337c1950de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de79305a-e8fc-4e8e-b549-2f450d1178aa', 'volume_name': 'volume-de79305a-e8fc-4e8e-b549-2f450d1178aa', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bdc61c-a2db-4a46-a82d-b172fd139fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bdc61c-a2db-4a46-a82d-b172fd139fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c9ae13-e682-48c8-b30b-74cc2551948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Volume de79305a-e8fc-4e8e-b549-2f450d1178aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de79305a-e8fc-4e8e-b549-2f450d1178aa', 'volume_size': 1} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-8148708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de79305a-e8fc-4e8e-b549-2f450d1178aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:25Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Creating volume de79305a-e8fc-4e8e-b549-2f450d1178aa {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:25 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:25 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e Nov 06 21:28:25 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:25 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa 1073741824 Nov 06 21:28:25 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:26 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa 1073741824" returned: 0 in 0.618s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:26 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e" returned: 0 in 0.817s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:26 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 Nov 06 21:28:26 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:26 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa Nov 06 21:28:26 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-3999f45e-2ed5-4930-bb45-dbd921db9c60 req-e252264e-3ad4-4ffb-a912-84ad0c8d031b tempest-TestMinimumBasicScenario-1644048841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:26 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa" returned: 0 in 0.336s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-3999f45e-2ed5-4930-bb45-dbd921db9c60 req-e252264e-3ad4-4ffb-a912-84ad0c8d031b tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.083s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-3999f45e-2ed5-4930-bb45-dbd921db9c60 req-e252264e-3ad4-4ffb-a912-84ad0c8d031b tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c9ae13-e682-48c8-b30b-74cc2551948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de79305a-e8fc-4e8e-b549-2f450d1178aa', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ab84b1-2530-4336-b515-730d6d3aefe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:26 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Volume volume-de79305a-e8fc-4e8e-b549-2f450d1178aa (de79305a-e8fc-4e8e-b549-2f450d1178aa): created successfully Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ab84b1-2530-4336-b515-730d6d3aefe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (602a77de-8dfd-4ba7-b334-fba6a365f45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-3999f45e-2ed5-4930-bb45-dbd921db9c60 req-e252264e-3ad4-4ffb-a912-84ad0c8d031b tempest-TestMinimumBasicScenario-1644048841 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94fcc126-bbcf-4fae-a89e-50027d4587fd', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:28:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9a0e2e8b-402c-4949-86af-a4edd17e5b84 tempest-VolumesActionsTest-1900086108 None] Created volume successfully. Nov 06 21:28:26 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" returned: 0 in 0.510s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:26 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367 Nov 06 21:28:26 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-3999f45e-2ed5-4930-bb45-dbd921db9c60 req-e252264e-3ad4-4ffb-a912-84ad0c8d031b tempest-TestMinimumBasicScenario-1644048841 None] attachment_update completed successfully. Nov 06 21:28:27 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e.4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367" released by "_delete_snapshot" :: held 2.354s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-ddd92d66-6f08-4703-a583-92385a05310e" released by "delete_snapshot" :: held 2.390s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Created reservations ['ee0c804b-d988-4ff5-a7de-a6fd6b21033c', 'b5820a27-8fa4-48fe-afe2-942253b1b68c', 'dbb3be37-c82a-4b38-86d9-b042ea7d45cb', '04830235-1220-4a29-a1e8-d4163a14eb77'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Delete snapshot completed successfully. Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-614c1281-a14e-4eff-a0f0-9a66eee80a71 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-4d636cfb-8807-4e7d-9e17-bdc3a2ec5367-delete_snapshot" released by "delete_snapshot" :: held 2.626s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-de79305a-e8fc-4e8e-b549-2f450d1178aa-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Lock "cinder-de79305a-e8fc-4e8e-b549-2f450d1178aa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-quobyte-de79305a-e8fc-4e8e-b549-2f450d1178aa" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-de79305a-e8fc-4e8e-b549-2f450d1178aa" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae19ad55-ee28-447f-a034-6d8a354c27c3]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-ddd92d66-6f08-4703-a583-92385a05310e-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:28 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa Nov 06 21:28:28 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-ddd92d66-6f08-4703-a583-92385a05310e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-quobyte-ddd92d66-6f08-4703-a583-92385a05310e" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-ddd92d66-6f08-4703-a583-92385a05310e" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[57235c55-ac3f-43f6-a20e-40b26e8666a4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:28 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e Nov 06 21:28:28 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa" returned: 0 in 0.646s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:28 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa Nov 06 21:28:28 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e" returned: 0 in 0.544s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:28 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e Nov 06 21:28:28 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-de79305a-e8fc-4e8e-b549-2f450d1178aa" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-de79305a-e8fc-4e8e-b549-2f450d1178aa" released by "delete_volume" :: held 1.066s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:28 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Created reservations ['8bd2cbeb-b57b-4b07-aa6e-336647e075be', '7a301150-a15a-45dc-87b7-06ce1addba7a', '079d65d7-2ff5-480b-a2f7-4e9ce878787e', '96e63189-35be-4e0a-8158-b8cba7af61d6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:29 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:29 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:29 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ddd92d66-6f08-4703-a583-92385a05310e" returned: 0 in 0.318s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-ddd92d66-6f08-4703-a583-92385a05310e" released by "delete_volume" :: held 0.952s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Created reservations ['b8d78892-9993-46b3-b750-34b5778564ae', 'd93c76a1-bc58-48e4-9126-8dbf6d1c601d', 'bdd0b75e-42e5-4818-8541-a86aa5534980', 'c71ae25a-e1d3-43f7-a843-92b5b11cee56'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:29 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:29 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:29 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.305s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Deleted volume successfully. Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-42ea769c-d1aa-4d58-8a0d-4200e386940a tempest-VolumesActionsTest-2132467548 None] Lock "cinder-de79305a-e8fc-4e8e-b549-2f450d1178aa-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:29 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.271s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Deleted volume successfully. Nov 06 21:28:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f49f8e3e-9265-48eb-a6fa-3f9ecc069d49 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-ddd92d66-6f08-4703-a583-92385a05310e-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-be53b2d2-331d-454e-9204-d70b8a55d37b-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-be53b2d2-331d-454e-9204-d70b8a55d37b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "cinder-quobyte-be53b2d2-331d-454e-9204-d70b8a55d37b" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (7c025d86-7159-4bee-9896-1e02d36b4e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1663acba-9946-464f-8340-7e98aafeb4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-be53b2d2-331d-454e-9204-d70b8a55d37b" acquired by "delete_volume" :: waited 0.058s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1663acba-9946-464f-8340-7e98aafeb4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185205988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5129442-2173-42f9-8b2f-4fac1a538448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:30Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef9d65b-e2ac-4059-be1d-603470947a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef9d65b-e2ac-4059-be1d-603470947a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea089e86-66cf-4701-b8db-a97ebc7aa621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea089e86-66cf-4701-b8db-a97ebc7aa621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5129442-2173-42f9-8b2f-4fac1a538448', 'volume_name': 'volume-c5129442-2173-42f9-8b2f-4fac1a538448', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31104c8a-09fc-43a5-984d-ad280c354f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31104c8a-09fc-43a5-984d-ad280c354f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db21df6-0072-401a-a2b2-e908ada971ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:30 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Volume c5129442-2173-42f9-8b2f-4fac1a538448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5129442-2173-42f9-8b2f-4fac1a538448', 'volume_size': 1} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185205988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5129442-2173-42f9-8b2f-4fac1a538448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:30Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Creating volume c5129442-2173-42f9-8b2f-4fac1a538448 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:30 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ba1e15-4375-4f7e-b53b-5a9814baaf7b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:30 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 1073741824 Nov 06 21:28:30 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:30 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b Nov 06 21:28:30 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b" returned: 0 in 0.401s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:31 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b Nov 06 21:28:31 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 1073741824" returned: 0 in 0.486s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:31 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 Nov 06 21:28:31 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-be53b2d2-331d-454e-9204-d70b8a55d37b" returned: 0 in 0.282s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-quobyte-be53b2d2-331d-454e-9204-d70b8a55d37b" released by "delete_volume" :: held 0.794s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Created reservations ['ed86abc6-915e-49e1-953d-42f772e3106f', '22f35816-b5b7-4d81-89ad-9c306d1085c9', '8088c586-b50c-4877-bc06-b91ff522cbed', '24306628-d081-4bf2-b854-2704a0b882ad'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:31 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448" returned: 0 in 0.314s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db21df6-0072-401a-a2b2-e908ada971ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5129442-2173-42f9-8b2f-4fac1a538448', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4af70e-98a9-4e57-bf2e-a7feff6eb76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:31 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Volume volume-c5129442-2173-42f9-8b2f-4fac1a538448 (c5129442-2173-42f9-8b2f-4fac1a538448): created successfully Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4af70e-98a9-4e57-bf2e-a7feff6eb76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (7c025d86-7159-4bee-9896-1e02d36b4e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-66015120-9f24-4658-8a65-774fe6461a06 tempest-VolumesActionsTest-1900086108 None] Created volume successfully. Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:31 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:31 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.307s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Deleted volume successfully. Nov 06 21:28:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-18e54945-b55c-4a2f-a586-033fc2c5b0f3 tempest-VolumeDependencyTests-2021270555 None] Lock "cinder-be53b2d2-331d-454e-9204-d70b8a55d37b-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-c5129442-2173-42f9-8b2f-4fac1a538448-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-c5129442-2173-42f9-8b2f-4fac1a538448-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-quobyte-c5129442-2173-42f9-8b2f-4fac1a538448" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-c5129442-2173-42f9-8b2f-4fac1a538448" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:32 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f86710-a75f-49cc-b66a-c65ed6730c10]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:33 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 Nov 06 21:28:33 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:33 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448" returned: 0 in 0.476s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:33 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448 Nov 06 21:28:33 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:33 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c5129442-2173-42f9-8b2f-4fac1a538448" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-c5129442-2173-42f9-8b2f-4fac1a538448" released by "delete_volume" :: held 0.861s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=111,cinder:INSERT=27,cinder:UPDATE=132,cinder:DELETE=12 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Created reservations ['b998bcd6-7bcc-48e5-ad37-65f3aad2fecd', 'c9cce66d-c501-4ad7-8d27-e337be5a3351', '0c94714b-2bb1-4374-aaa1-50d541673c14', 'acffe973-b2f7-4861-a1c5-1a4602fef2bc'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:33 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:33 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:34 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.312s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Deleted volume successfully. Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fd9248b6-d149-4c82-9501-347c8f49e7f6 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-c5129442-2173-42f9-8b2f-4fac1a538448-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (50c8b528-3ba0-4b34-86db-7859c2f43949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e331627e-7dd7-46fe-9cca-3571fbf65dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e331627e-7dd7-46fe-9cca-3571fbf65dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1913353759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:35Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f98dec5-07ae-43d5-b07d-c0e047ffeff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f98dec5-07ae-43d5-b07d-c0e047ffeff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feef4346-cd7d-453d-9377-6545130a83b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feef4346-cd7d-453d-9377-6545130a83b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf', 'volume_name': 'volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b03b4d-d968-45ee-be4c-9c9212defc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b03b4d-d968-45ee-be4c-9c9212defc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f24dca-d797-43d4-a325-173a714ba3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Volume 76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf', 'volume_size': 1} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1913353759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:35Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Creating volume 76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:34 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf 1073741824 Nov 06 21:28:35 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf 1073741824" returned: 0 in 0.628s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf Nov 06 21:28:35 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf" returned: 0 in 0.329s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f24dca-d797-43d4-a325-173a714ba3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48273869-2301-424b-8ecd-3b33da9a24cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Volume volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf (76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf): created successfully Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48273869-2301-424b-8ecd-3b33da9a24cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (50c8b528-3ba0-4b34-86db-7859c2f43949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b248d658-bba4-432f-bf0e-5c7d6b169c64 tempest-VolumesActionsTest-1900086108 None] Created volume successfully. Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Flow 'volume_create_manager' (db467004-8112-4a43-b112-f72ca95900f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d2da1c-ae00-4035-975f-bbacc5a30659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d2da1c-ae00-4035-975f-bbacc5a30659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794357552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b0dfe1-5ee9-4b67-8adb-7935ee761a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c4ec288f14717a7a62020bb185714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:37Z,use_quota=True,user_id='737c94697e2341e9b75be01d59c898ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2031a6b4-c33f-47b8-9855-60fb96495645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2031a6b4-c33f-47b8-9855-60fb96495645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ea7151-a83b-4251-b18d-26fc781535b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ea7151-a83b-4251-b18d-26fc781535b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b0dfe1-5ee9-4b67-8adb-7935ee761a54', 'volume_name': 'volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3595b605-6b2c-4f21-9a99-68e9dea12b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3595b605-6b2c-4f21-9a99-68e9dea12b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7d39a8-b9c4-46ae-9e87-2e5c2e7b3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Volume c0b0dfe1-5ee9-4b67-8adb-7935ee761a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54', 'volume_size': 1} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794357552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b0dfe1-5ee9-4b67-8adb-7935ee761a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c4ec288f14717a7a62020bb185714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:37Z,use_quota=True,user_id='737c94697e2341e9b75be01d59c898ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Creating volume c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:36 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:36 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 1073741824 Nov 06 21:28:36 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Lock "cinder-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-quobyte-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d93573a-d74a-4f1d-989c-257944eae857]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:37 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf Nov 06 21:28:37 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:37 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 1073741824" returned: 0 in 0.708s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:37 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 Nov 06 21:28:37 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:37 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:37 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf Nov 06 21:28:37 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:37 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54" returned: 0 in 0.313s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7d39a8-b9c4-46ae-9e87-2e5c2e7b3184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6f147d-98d7-4e60-9814-0c33cd37edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Volume volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 (c0b0dfe1-5ee9-4b67-8adb-7935ee761a54): created successfully Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6f147d-98d7-4e60-9814-0c33cd37edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Flow 'volume_create_manager' (db467004-8112-4a43-b112-f72ca95900f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5c366430-e9cb-4130-8f5e-695370031096 tempest-ProjectReaderTests-641235819 None] Created volume successfully. Nov 06 21:28:38 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf" returned: 0 in 0.257s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf" released by "delete_volume" :: held 0.783s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Created reservations ['893150cf-6334-492e-ac4b-5c1e6d52a8cb', 'c643e42c-de5c-4f36-a9d3-ce48ba0c57a4', '4913a276-a514-4f10-a2db-f03a88338c25', '1a5feef3-31b2-4843-938c-4afe3d55c6e4'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:38 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:38 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:38 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.272s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Deleted volume successfully. Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c3998287-e1f5-4906-a747-41baa8508f4d tempest-VolumesActionsTest-2132467548 None] Lock "cinder-76a9c3fc-d8a2-4953-bdc0-a61f1d0759cf-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Acquiring lock "cinder-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Lock "cinder-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Acquiring lock "cinder-quobyte-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (e1ef23c7-ae51-4e71-b8ae-8d5f3b7db698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd4ef2b-5f1b-4020-8c5c-5a0f630cef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Lock "cinder-quobyte-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54" acquired by "delete_volume" :: waited 0.043s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd4ef2b-5f1b-4020-8c5c-5a0f630cef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692033789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf39c41-a1b7-4543-89ba-6dad2a6748a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:39Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6716074f-0ac5-4bff-8fee-272285d806d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6716074f-0ac5-4bff-8fee-272285d806d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fa804e-fdf2-4e1d-a38f-c25118efb920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fa804e-fdf2-4e1d-a38f-c25118efb920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf39c41-a1b7-4543-89ba-6dad2a6748a8', 'volume_name': 'volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274e554a-5f6c-4f8b-950b-c45600ef4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274e554a-5f6c-4f8b-950b-c45600ef4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cd9ff1-9e73-49d6-896d-633bd928a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Volume 6cf39c41-a1b7-4543-89ba-6dad2a6748a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8', 'volume_size': 1} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692033789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf39c41-a1b7-4543-89ba-6dad2a6748a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:39Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Creating volume 6cf39c41-a1b7-4543-89ba-6dad2a6748a8 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:39 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fdf167-bb46-4a33-a9bb-9dc7cd644da6]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:39 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 1073741824 Nov 06 21:28:39 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:39 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 Nov 06 21:28:39 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:39 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54" returned: 0 in 0.397s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:39 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54 Nov 06 21:28:39 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:39 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 1073741824" returned: 0 in 0.467s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:39 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 Nov 06 21:28:39 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:39 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54" returned: 0 in 0.292s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Lock "cinder-quobyte-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54" released by "delete_volume" :: held 0.817s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Created reservations ['2bcf7b0e-847a-4724-8731-9614c63c3d20', '7fcbf1d3-fb8b-44c4-813a-e15dbae7a3ea', 'ba93a078-32fc-40e8-a1a7-6750995bc21f', '251d6d58-798e-4810-8401-8049412392be'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:39 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8" returned: 0 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cd9ff1-9e73-49d6-896d-633bd928a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5d6009-f521-4b7f-9bc2-c3b3cf431aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:40 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Volume volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 (6cf39c41-a1b7-4543-89ba-6dad2a6748a8): created successfully Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5d6009-f521-4b7f-9bc2-c3b3cf431aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (e1ef23c7-ae51-4e71-b8ae-8d5f3b7db698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0541ba38-fc3e-41b9-97bf-68da21272a8c tempest-VolumesActionsTest-1900086108 None] Created volume successfully. Nov 06 21:28:40 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.315s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Deleted volume successfully. Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-eac16f8a-6f8f-47c4-a3f4-cb6135fe9f7e tempest-ProjectReaderTests-641235819 None] Lock "cinder-c0b0dfe1-5ee9-4b67-8adb-7935ee761a54-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Flow 'volume_create_manager' (6cb7bf48-cfdf-4534-a93d-961eae937034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba03422-71e8-4dd7-b919-05273e5aa55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba03422-71e8-4dd7-b919-05273e5aa55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660688849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a050538-d78c-46f8-a11a-1bd44ee26d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c4ec288f14717a7a62020bb185714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:41Z,use_quota=True,user_id='737c94697e2341e9b75be01d59c898ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d01cc0-ebc0-4064-968a-9b3fe1dbc85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d01cc0-ebc0-4064-968a-9b3fe1dbc85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a879b5f8-7800-4baf-a0cd-bf16fe1903c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a879b5f8-7800-4baf-a0cd-bf16fe1903c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a050538-d78c-46f8-a11a-1bd44ee26d21', 'volume_name': 'volume-8a050538-d78c-46f8-a11a-1bd44ee26d21', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fffdce-a70f-4577-89eb-bea132878294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fffdce-a70f-4577-89eb-bea132878294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e89235e-d58f-4258-8875-2e1891c87603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Volume 8a050538-d78c-46f8-a11a-1bd44ee26d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a050538-d78c-46f8-a11a-1bd44ee26d21', 'volume_size': 1} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660688849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a050538-d78c-46f8-a11a-1bd44ee26d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c4ec288f14717a7a62020bb185714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:41Z,use_quota=True,user_id='737c94697e2341e9b75be01d59c898ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Creating volume 8a050538-d78c-46f8-a11a-1bd44ee26d21 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:40 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:40 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 1073741824 Nov 06 21:28:40 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:41 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-6cf39c41-a1b7-4543-89ba-6dad2a6748a8-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 1073741824" returned: 0 in 0.505s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-6cf39c41-a1b7-4543-89ba-6dad2a6748a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Acquiring lock "cinder-quobyte-6cf39c41-a1b7-4543-89ba-6dad2a6748a8" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:41 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 Nov 06 21:28:41 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-6cf39c41-a1b7-4543-89ba-6dad2a6748a8" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed94c9-8d79-460f-93f0-f3f2cd071637]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:41 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 Nov 06 21:28:41 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:41 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21" returned: 0 in 0.282s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e89235e-d58f-4258-8875-2e1891c87603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a050538-d78c-46f8-a11a-1bd44ee26d21', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1db1f4-7600-4cde-9d7d-d7d94bbc462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:41 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Volume volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 (8a050538-d78c-46f8-a11a-1bd44ee26d21): created successfully Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1db1f4-7600-4cde-9d7d-d7d94bbc462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Flow 'volume_create_manager' (6cb7bf48-cfdf-4534-a93d-961eae937034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0ac951e0-4a18-472c-9e4a-11a120dd7519 tempest-ProjectReaderTests-641235819 None] Created volume successfully. Nov 06 21:28:41 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8" returned: 0 in 0.392s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:41 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8 Nov 06 21:28:41 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:42 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6cf39c41-a1b7-4543-89ba-6dad2a6748a8" returned: 0 in 0.260s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-quobyte-6cf39c41-a1b7-4543-89ba-6dad2a6748a8" released by "delete_volume" :: held 0.715s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Created reservations ['fe9c506f-dee0-47bc-8fa0-7fe9ba568d4e', 'b4f24701-44a6-4638-9426-ca3b21e5a3b9', 'e42c6d44-409a-477f-a625-58961031be74', '63d4f570-2510-4b91-a803-73c61c9c1a7a'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:42 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:42 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:42 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.268s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Deleted volume successfully. Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-260cfc23-e0a5-4fb3-9378-d8ce0e0c9815 tempest-VolumesActionsTest-2132467548 None] Lock "cinder-6cf39c41-a1b7-4543-89ba-6dad2a6748a8-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Acquiring lock "cinder-8a050538-d78c-46f8-a11a-1bd44ee26d21-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Lock "cinder-8a050538-d78c-46f8-a11a-1bd44ee26d21-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Acquiring lock "cinder-quobyte-8a050538-d78c-46f8-a11a-1bd44ee26d21" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Lock "cinder-quobyte-8a050538-d78c-46f8-a11a-1bd44ee26d21" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a3bba-d610-41ca-9237-c05793142cce]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (172596e6-685a-4062-be49-ff22459480bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eaa5b3-5bfa-4c7d-be6c-fd389ed2744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eaa5b3-5bfa-4c7d-be6c-fd389ed2744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785131661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ca313f-824a-4c3c-be4e-5d70efc86a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:43Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298fc756-3f1a-4aa8-8e39-d60318f147c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298fc756-3f1a-4aa8-8e39-d60318f147c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e703f05-4209-4adb-b35b-2269804c4e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e703f05-4209-4adb-b35b-2269804c4e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ca313f-824a-4c3c-be4e-5d70efc86a52', 'volume_name': 'volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:43 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 Nov 06 21:28:43 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643ede1c-f8de-4310-b4a3-fd76c2bdc45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643ede1c-f8de-4310-b4a3-fd76c2bdc45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4132e4d5-b530-4522-8f75-e85e42b1533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:43 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Volume b6ca313f-824a-4c3c-be4e-5d70efc86a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52', 'volume_size': 1} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785131661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ca313f-824a-4c3c-be4e-5d70efc86a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b4a13f99bd4dcfbbffce29c8c6f2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:43Z,use_quota=True,user_id='30553401af7a4494bfad2d2bb43766b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Creating volume b6ca313f-824a-4c3c-be4e-5d70efc86a52 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:43 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:43 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 1073741824 Nov 06 21:28:43 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:43 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21" returned: 0 in 0.394s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:43 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21 Nov 06 21:28:43 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:43 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 1073741824" returned: 0 in 0.470s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:43 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-8a050538-d78c-46f8-a11a-1bd44ee26d21" returned: 0 in 0.271s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:43 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 Nov 06 21:28:43 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Lock "cinder-quobyte-8a050538-d78c-46f8-a11a-1bd44ee26d21" released by "delete_volume" :: held 0.732s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Created reservations ['fcd6fdf8-a0c6-40eb-b1d8-36228dec080f', '268a4ed8-9bd0-426f-86aa-3bbe9d20ce47', '91ff5124-662d-4394-9469-cb8f18d8b93d', '9809e053-8e6d-4be6-8a16-fa4c28c624fa'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:43 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:43 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:43 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52" returned: 0 in 0.287s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4132e4d5-b530-4522-8f75-e85e42b1533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d8dc5-7924-4cfa-b38d-985eb55a7abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:43 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Volume volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 (b6ca313f-824a-4c3c-be4e-5d70efc86a52): created successfully Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d8dc5-7924-4cfa-b38d-985eb55a7abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Flow 'volume_create_manager' (172596e6-685a-4062-be49-ff22459480bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:43 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a7189a7c-f76a-498a-9828-759b56c748e8 tempest-VolumesActionsTest-1900086108 None] Created volume successfully. Nov 06 21:28:44 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.352s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:44 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Deleted volume successfully. Nov 06 21:28:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f544560c-aa04-4fe5-8c26-3cc5e6a4338c tempest-ProjectReaderTests-641235819 None] Lock "cinder-8a050538-d78c-46f8-a11a-1bd44ee26d21-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "cinder-b6ca313f-824a-4c3c-be4e-5d70efc86a52-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-b6ca313f-824a-4c3c-be4e-5d70efc86a52-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "cinder-quobyte-b6ca313f-824a-4c3c-be4e-5d70efc86a52" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-quobyte-b6ca313f-824a-4c3c-be4e-5d70efc86a52" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a0954-038c-4eab-b883-491e34f2fbce]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:46 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 Nov 06 21:28:46 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:46 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52" returned: 0 in 0.425s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:46 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52 Nov 06 21:28:46 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:46 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b6ca313f-824a-4c3c-be4e-5d70efc86a52" returned: 0 in 0.395s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-quobyte-b6ca313f-824a-4c3c-be4e-5d70efc86a52" released by "delete_volume" :: held 0.885s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Created reservations ['020938b9-3653-44d9-91e0-cc172cd29a40', 'd71d5dfc-e565-459d-9867-019ab55d5ef7', 'ab3d0d1e-2b13-41b5-8bce-7b142442973a', 'f2e2b9a9-8371-4381-80e3-0704ea3fcad7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:47 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:28:47 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:47 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Deleted volume successfully. Nov 06 21:28:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2517f0d-efeb-474b-958f-7c4234dbb532 tempest-VolumesActionsTest-1900086108 None] Lock "cinder-b6ca313f-824a-4c3c-be4e-5d70efc86a52-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:57 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=34,cinder:INSERT=20,cinder:UPDATE=68,cinder:DELETE=7 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:57 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:INSERT=21,cinder:UPDATE=102,cinder:SELECT=77,cinder:DELETE=7 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Flow 'volume_create_manager' (756b9012-b6e7-4478-92d8-611f96c86206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfc3725-d9e7-441a-8fc7-12fb5116583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfc3725-d9e7-441a-8fc7-12fb5116583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1432505159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594e6c20-8d4a-4fec-9f6e-7d491d03338e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fb5d8c0813421481d6aea18102369a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:02Z,use_quota=True,user_id='7d72244fdcda4bf099ccb7463fca058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee53c67-506d-44d7-bfb6-7755d535b9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee53c67-506d-44d7-bfb6-7755d535b9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9331c6-3ac3-4341-a493-0d25543fb606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9331c6-3ac3-4341-a493-0d25543fb606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594e6c20-8d4a-4fec-9f6e-7d491d03338e', 'volume_name': 'volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a6fe2e-a71e-40fa-a716-95980f7962df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a6fe2e-a71e-40fa-a716-95980f7962df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e48c29-f2d7-478e-8b6a-9c4b1f07114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Volume 594e6c20-8d4a-4fec-9f6e-7d491d03338e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e', 'volume_size': 1} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1432505159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594e6c20-8d4a-4fec-9f6e-7d491d03338e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fb5d8c0813421481d6aea18102369a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:02Z,use_quota=True,user_id='7d72244fdcda4bf099ccb7463fca058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Creating volume 594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:01 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:29:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:01 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e 1073741824 Nov 06 21:29:01 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:02 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e 1073741824" returned: 0 in 0.446s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:02 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e Nov 06 21:29:02 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:02 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e" returned: 0 in 0.260s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e48c29-f2d7-478e-8b6a-9c4b1f07114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b190e663-1a71-47e7-967c-49fdcaaf27f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Volume volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e (594e6c20-8d4a-4fec-9f6e-7d491d03338e): created successfully Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b190e663-1a71-47e7-967c-49fdcaaf27f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Flow 'volume_create_manager' (756b9012-b6e7-4478-92d8-611f96c86206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-290d6179-0c65-4724-889b-d19e4f7eb3de tempest-SnapshotMetadataTestJSON-1994967097 None] Created volume successfully. Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Creating offline snapshot 5690bd5d-6287-4a71-aaa0-08cad5a43708 of volume 594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8afb59-f53c-4f38-a33e-aaf3bcfe4fec]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:02 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e Nov 06 21:29:02 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:03 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e" returned: 0 in 0.389s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:03 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 1G Nov 06 21:29:03 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:03 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 1G" returned: 0 in 0.413s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:03 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 Nov 06 21:29:03 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:03 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708" returned: 0 in 0.304s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:03 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 is being set with open permissions: ugo+rw Nov 06 21:29:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:04 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 Nov 06 21:29:04 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:04 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708" returned: 0 in 0.259s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:04 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.info Nov 06 21:29:04 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:04 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.info" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:04 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.info is being set with open permissions: ugo+rw Nov 06 21:29:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:04 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.info Nov 06 21:29:04 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:04 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.info" returned: 0 in 0.267s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fc596143-e8c2-4152-b611-9d74adb26dee tempest-SnapshotMetadataTestJSON-1994967097 None] Create snapshot completed successfully Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "cinder-5690bd5d-6287-4a71-aaa0-08cad5a43708-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-5690bd5d-6287-4a71-aaa0-08cad5a43708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "cinder-quobyte-594e6c20-8d4a-4fec-9f6e-7d491d03338e" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-quobyte-594e6c20-8d4a-4fec-9f6e-7d491d03338e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "cinder-quobyte-5690bd5d-6287-4a71-aaa0-08cad5a43708" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-quobyte-5690bd5d-6287-4a71-aaa0-08cad5a43708" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Deleting offline snapshot 5690bd5d-6287-4a71-aaa0-08cad5a43708 of volume 594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] snapshot_file for this snap is: volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99518f4-0997-4a7a-ad0c-1370b2574485]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:05 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 Nov 06 21:29:05 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:06 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708" returned: 0 in 0.368s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:29:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[df61de00-12ef-45e8-8b20-58d3fee5a59c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:06 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e Nov 06 21:29:06 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:06 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e" returned: 0 in 0.373s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:06 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 Nov 06 21:29:06 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:07 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708" returned: 0 in 0.362s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:07 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708 Nov 06 21:29:07 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:07 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e.5690bd5d-6287-4a71-aaa0-08cad5a43708" returned: 0 in 0.274s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-quobyte-5690bd5d-6287-4a71-aaa0-08cad5a43708" released by "_delete_snapshot" :: held 1.504s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-quobyte-594e6c20-8d4a-4fec-9f6e-7d491d03338e" released by "delete_snapshot" :: held 1.530s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:07 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Created reservations ['efa6ee7a-cc1e-4911-85b1-2d32661c8df9', '889fa000-bbbd-4896-a36b-46cd72011f8c', 'c7d45848-a5cf-4e8a-97df-00b9ed214dda', '61427715-12ea-40a8-901b-53775c1d983e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Delete snapshot completed successfully. Nov 06 21:29:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-64f51926-c750-4015-9d79-30afa058272b tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-5690bd5d-6287-4a71-aaa0-08cad5a43708-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "cinder-594e6c20-8d4a-4fec-9f6e-7d491d03338e-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-594e6c20-8d4a-4fec-9f6e-7d491d03338e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "cinder-quobyte-594e6c20-8d4a-4fec-9f6e-7d491d03338e" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-quobyte-594e6c20-8d4a-4fec-9f6e-7d491d03338e" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3123ad-9d76-4d40-a4ec-6775cad042ce]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:08 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e Nov 06 21:29:08 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:08 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e" returned: 0 in 0.418s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:08 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e Nov 06 21:29:08 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:08 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-594e6c20-8d4a-4fec-9f6e-7d491d03338e" returned: 0 in 0.343s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-quobyte-594e6c20-8d4a-4fec-9f6e-7d491d03338e" released by "delete_volume" :: held 0.834s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Created reservations ['b69c8d94-8063-4936-8970-1ae971e8aa19', '47949af6-d6a0-40d6-a250-3d171497cbe2', 'b0ed9a60-fc0b-4869-a35e-415ea0e71c53', 'e75a693c-772c-4f13-8153-02161e18b210'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:09 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:29:09 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:09 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.352s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Deleted volume successfully. Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0348398b-1d5c-47a8-84d1-b2407a385220 tempest-SnapshotMetadataTestJSON-1994967097 None] Lock "cinder-594e6c20-8d4a-4fec-9f6e-7d491d03338e-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-5f7693fa-c6cc-4c8e-81fd-dbbee8e47b8b req-d62a9b25-0ae7-4954-9a59-3a0be4faf2ea tempest-TestMinimumBasicScenario-1644048841 None] Terminate volume connection completed successfully. Nov 06 21:29:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-5f7693fa-c6cc-4c8e-81fd-dbbee8e47b8b req-d62a9b25-0ae7-4954-9a59-3a0be4faf2ea tempest-TestMinimumBasicScenario-1644048841 None] Deleting attachment 94fcc126-bbcf-4fae-a89e-50027d4587fd. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:29:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Acquiring lock "cinder-da1753b6-ef2d-4875-852d-0dbf8e3233f6-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Lock "cinder-da1753b6-ef2d-4875-852d-0dbf8e3233f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Acquiring lock "cinder-quobyte-da1753b6-ef2d-4875-852d-0dbf8e3233f6" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Lock "cinder-quobyte-da1753b6-ef2d-4875-852d-0dbf8e3233f6" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:10 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ebca4f-18d0-41b2-81c7-ded0ee733292]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:10 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 Nov 06 21:29:10 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:11 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6" returned: 0 in 0.429s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:11 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6 Nov 06 21:29:11 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:11 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:29:11 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:11 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-da1753b6-ef2d-4875-852d-0dbf8e3233f6" returned: 0 in 0.291s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Lock "cinder-quobyte-da1753b6-ef2d-4875-852d-0dbf8e3233f6" released by "delete_volume" :: held 0.772s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Created reservations ['fb9049a8-1632-4af7-9253-dc3a220cc5ea', 'aac6ee03-5c94-488d-b307-2ce3f41c116d', '002117a3-99a0-4b0b-973f-d3168aed4efd', '8fda68dd-6f8b-43df-a7c8-1fbda15a6827'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:11 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:11 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:29:11 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:11 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.259s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:11 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Deleted volume successfully. Nov 06 21:29:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1f62af40-8ae9-4954-91b1-f74ad9d15c2e tempest-TestMinimumBasicScenario-1644048841 None] Lock "cinder-da1753b6-ef2d-4875-852d-0dbf8e3233f6-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Flow 'volume_create_manager' (e2af9f55-1e0b-4f66-af73-be52a1f9daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a908314-21b2-44c2-b54b-a95dae572dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a908314-21b2-44c2-b54b-a95dae572dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-476976407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9a4589-4a7e-4061-9183-abaa351429d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab6f8012f7a4f769f5e8aea0ba603f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:15Z,use_quota=True,user_id='e2c935e618944105b48b182b20fdc737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60587fa2-9a4c-4372-a697-65ec469a6083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60587fa2-9a4c-4372-a697-65ec469a6083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220e1095-d238-4e12-89e1-69d970cfb1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220e1095-d238-4e12-89e1-69d970cfb1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9a4589-4a7e-4061-9183-abaa351429d6', 'volume_name': 'volume-2c9a4589-4a7e-4061-9183-abaa351429d6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28d2828-9a4f-451d-9f67-0b9363fde9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28d2828-9a4f-451d-9f67-0b9363fde9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c8113c-a206-471d-9a4e-bae733d4c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:15 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Volume 2c9a4589-4a7e-4061-9183-abaa351429d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9a4589-4a7e-4061-9183-abaa351429d6', 'volume_size': 1} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-476976407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9a4589-4a7e-4061-9183-abaa351429d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab6f8012f7a4f769f5e8aea0ba603f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:15Z,use_quota=True,user_id='e2c935e618944105b48b182b20fdc737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Creating volume 2c9a4589-4a7e-4061-9183-abaa351429d6 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:15 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:29:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:15 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 1073741824 Nov 06 21:29:15 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:16 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 1073741824" returned: 0 in 0.489s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:16 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 Nov 06 21:29:16 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:16 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6" returned: 0 in 0.328s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c8113c-a206-471d-9a4e-bae733d4c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9a4589-4a7e-4061-9183-abaa351429d6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef832d46-e715-4176-8a54-958db327c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Volume volume-2c9a4589-4a7e-4061-9183-abaa351429d6 (2c9a4589-4a7e-4061-9183-abaa351429d6): created successfully Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef832d46-e715-4176-8a54-958db327c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Flow 'volume_create_manager' (e2af9f55-1e0b-4f66-af73-be52a1f9daf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9e78dada-8ff3-4ca6-901b-19b90908cbd1 tempest-VolumesTransfersV355Test-1154310301 None] Created volume successfully. Nov 06 21:29:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-08720c9d-f523-4d0a-9141-78aa2f8cddf6 tempest-VolumesTransfersV355Test-693819059 None] Transfer volume completed successfully. Nov 06 21:29:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Acquiring lock "cinder-2c9a4589-4a7e-4061-9183-abaa351429d6-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-2c9a4589-4a7e-4061-9183-abaa351429d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Acquiring lock "cinder-quobyte-2c9a4589-4a7e-4061-9183-abaa351429d6" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-quobyte-2c9a4589-4a7e-4061-9183-abaa351429d6" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca9b94d-9854-491b-b6b0-285d44d7f57c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:19 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 Nov 06 21:29:19 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:19 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6" returned: 0 in 0.415s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:19 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6 Nov 06 21:29:19 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:19 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-2c9a4589-4a7e-4061-9183-abaa351429d6" returned: 0 in 0.274s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-quobyte-2c9a4589-4a7e-4061-9183-abaa351429d6" released by "delete_volume" :: held 0.737s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Created reservations ['f41c9879-9068-49b0-ac0d-ad0f6cb9fa35', '7a9c15fe-46a9-469f-ac12-f3954eaa3e8e', 'cc9e92f1-60cb-4a32-8790-5260165c5038', '4db488de-01a6-4362-b7f0-6a3a273f375d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:19 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:29:19 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:20 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Deleted volume successfully. Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2f58234-b8b2-4233-b289-318fa912d44c tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-2c9a4589-4a7e-4061-9183-abaa351429d6-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Flow 'volume_create_manager' (9e19c4fc-0463-40ed-bed5-c89001193ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdd0e9f-85d2-4101-849d-e0f73757be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdd0e9f-85d2-4101-849d-e0f73757be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1367005146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ea77a5-6b96-45a7-a59c-8b3067469c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab6f8012f7a4f769f5e8aea0ba603f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:21Z,use_quota=True,user_id='e2c935e618944105b48b182b20fdc737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6605fcc-1dba-4623-b8e7-cf8b3ba9b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6605fcc-1dba-4623-b8e7-cf8b3ba9b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5610a784-1778-4f2f-8057-226c8bf56a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5610a784-1778-4f2f-8057-226c8bf56a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ea77a5-6b96-45a7-a59c-8b3067469c51', 'volume_name': 'volume-95ea77a5-6b96-45a7-a59c-8b3067469c51', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67eeef62-7fb3-43db-af3e-df0d655cab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67eeef62-7fb3-43db-af3e-df0d655cab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca49adc-2a95-4d49-98cd-dcf0632cce62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:20 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Volume 95ea77a5-6b96-45a7-a59c-8b3067469c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ea77a5-6b96-45a7-a59c-8b3067469c51', 'volume_size': 1} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1367005146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ea77a5-6b96-45a7-a59c-8b3067469c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab6f8012f7a4f769f5e8aea0ba603f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:21Z,use_quota=True,user_id='e2c935e618944105b48b182b20fdc737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Creating volume 95ea77a5-6b96-45a7-a59c-8b3067469c51 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:20 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:29:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:20 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 1073741824 Nov 06 21:29:20 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:21 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 1073741824" returned: 0 in 0.476s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:21 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 Nov 06 21:29:21 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:21 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca49adc-2a95-4d49-98cd-dcf0632cce62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ea77a5-6b96-45a7-a59c-8b3067469c51', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16907380-89b1-4322-9909-87eff41d7219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:21 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Volume volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 (95ea77a5-6b96-45a7-a59c-8b3067469c51): created successfully Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16907380-89b1-4322-9909-87eff41d7219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Flow 'volume_create_manager' (9e19c4fc-0463-40ed-bed5-c89001193ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d0c3d238-2649-4618-9f67-823f80a60832 tempest-VolumesTransfersV355Test-1154310301 None] Created volume successfully. Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Acquiring lock "cinder-95ea77a5-6b96-45a7-a59c-8b3067469c51-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-95ea77a5-6b96-45a7-a59c-8b3067469c51-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Acquiring lock "cinder-quobyte-95ea77a5-6b96-45a7-a59c-8b3067469c51" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-quobyte-95ea77a5-6b96-45a7-a59c-8b3067469c51" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2d57b7-ecc9-4e01-861f-93d843390afd]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:23 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 Nov 06 21:29:23 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:23 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51" returned: 0 in 0.472s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:23 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51 Nov 06 21:29:23 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:23 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-95ea77a5-6b96-45a7-a59c-8b3067469c51" returned: 0 in 0.276s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-quobyte-95ea77a5-6b96-45a7-a59c-8b3067469c51" released by "delete_volume" :: held 0.794s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Created reservations ['5f5cbc19-240b-4400-b2a2-7c47e666a3a4', 'e0f998b9-02e1-441e-bef9-5d2b27b5dd09', '1bc15521-a842-4a92-969e-adba18e93e14', '3d0e6beb-3689-498b-b816-5a60537b2cee'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:24 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:29:24 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:24 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Deleted volume successfully. Nov 06 21:29:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-279b4e54-4e9c-4004-a83e-674c064be481 tempest-VolumesTransfersV355Test-942553982 None] Lock "cinder-95ea77a5-6b96-45a7-a59c-8b3067469c51-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:34 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=34,cinder:UPDATE=49,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:29:34 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=47,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:29:48 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Flow 'volume_create_manager' (d7592105-ab6c-41da-ac3a-a0fdb912bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32178285-4028-4fab-865f-7f44d112999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32178285-4028-4fab-865f-7f44d112999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2120321349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1677ad7d-1ddd-4188-8aa5-4b6270931f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616777e49eb14c6ca38f5e7d02d20291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:49Z,use_quota=True,user_id='a119b2d1d7b14d0db42d3cbc18ddb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4e6597-899c-49cb-87b2-675851d47ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4e6597-899c-49cb-87b2-675851d47ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ddce93-2363-4608-b729-7cb2c4ca60ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ddce93-2363-4608-b729-7cb2c4ca60ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1677ad7d-1ddd-4188-8aa5-4b6270931f63', 'volume_name': 'volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab76a7e-54fe-49e5-b3f3-480aa24b8333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab76a7e-54fe-49e5-b3f3-480aa24b8333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1516fb2-ff4c-472f-ad40-a51d6fd5d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Volume 1677ad7d-1ddd-4188-8aa5-4b6270931f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63', 'volume_size': 1} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2120321349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1677ad7d-1ddd-4188-8aa5-4b6270931f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616777e49eb14c6ca38f5e7d02d20291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:49Z,use_quota=True,user_id='a119b2d1d7b14d0db42d3cbc18ddb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Creating volume 1677ad7d-1ddd-4188-8aa5-4b6270931f63 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:49 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:49 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 1073741824 Nov 06 21:29:49 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Flow 'volume_create_manager' (53b963a0-7f8d-4738-967e-4d458ff08ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb33303-e3e4-492c-aa62-098f598da065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb33303-e3e4-492c-aa62-098f598da065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-670554641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dae2d09-afef-402a-91cd-a4ff34f8f35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616777e49eb14c6ca38f5e7d02d20291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:49Z,use_quota=True,user_id='a119b2d1d7b14d0db42d3cbc18ddb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b95a5b6-aa45-4e10-a662-807828a7f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b95a5b6-aa45-4e10-a662-807828a7f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4e8a6b-a114-4f72-bfc1-695df21b126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4e8a6b-a114-4f72-bfc1-695df21b126f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dae2d09-afef-402a-91cd-a4ff34f8f35f', 'volume_name': 'volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf6ba5e-f237-47f1-9ba9-42b48af8112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf6ba5e-f237-47f1-9ba9-42b48af8112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3eb0af-7c13-429c-a6ed-40139d5aafa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Volume 7dae2d09-afef-402a-91cd-a4ff34f8f35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f', 'volume_size': 1} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:49 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 1073741824" returned: 0 in 0.769s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Flow 'volume_create_manager' (fb44863b-5dac-43c8-8e4f-1b913eb8ff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1cb1f9-24ab-45c5-849a-c5ccb5aca2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1cb1f9-24ab-45c5-849a-c5ccb5aca2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394599006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b441ce70-55fd-45b7-8cf3-5acabbfda255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dac353a7da9444ebe07f5df14800080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:50Z,use_quota=True,user_id='5f2faf5741464893895e49d8a876acc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 Nov 06 21:29:49 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0718b5-52c6-41bc-bd32-133180e92138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0718b5-52c6-41bc-bd32-133180e92138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025cbe96-0df2-4bf5-b14c-4dcd98edc6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025cbe96-0df2-4bf5-b14c-4dcd98edc6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b441ce70-55fd-45b7-8cf3-5acabbfda255', 'volume_name': 'volume-b441ce70-55fd-45b7-8cf3-5acabbfda255', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1550a728-d23c-4eb7-b70f-788e3ea7dd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1550a728-d23c-4eb7-b70f-788e3ea7dd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b0ddbb-370d-48ad-9c8f-4dcba37519cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:50 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Volume b441ce70-55fd-45b7-8cf3-5acabbfda255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b441ce70-55fd-45b7-8cf3-5acabbfda255', 'volume_size': 1} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:50 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63" returned: 0 in 0.282s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-670554641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dae2d09-afef-402a-91cd-a4ff34f8f35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616777e49eb14c6ca38f5e7d02d20291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:49Z,use_quota=True,user_id='a119b2d1d7b14d0db42d3cbc18ddb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Creating volume 7dae2d09-afef-402a-91cd-a4ff34f8f35f {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:50 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1516fb2-ff4c-472f-ad40-a51d6fd5d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7bd0cd-50c6-4959-b230-7a1221972fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:50 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f 1073741824 Nov 06 21:29:50 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:50 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Volume volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 (1677ad7d-1ddd-4188-8aa5-4b6270931f63): created successfully Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7bd0cd-50c6-4959-b230-7a1221972fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Flow 'volume_create_manager' (d7592105-ab6c-41da-ac3a-a0fdb912bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-adc22103-72bf-4741-9202-f407b715b1b5 tempest-TestServerVolumeAttachmentScenario-813906943 None] Created volume successfully. Nov 06 21:29:50 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f 1073741824" returned: 0 in 0.561s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:50 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f Nov 06 21:29:50 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:51 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f" returned: 0 in 0.264s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394599006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b441ce70-55fd-45b7-8cf3-5acabbfda255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dac353a7da9444ebe07f5df14800080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:50Z,use_quota=True,user_id='5f2faf5741464893895e49d8a876acc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Creating volume b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:51 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3eb0af-7c13-429c-a6ed-40139d5aafa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290f7358-9aff-4a9f-8be1-a743ee31759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:51 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 1073741824 Nov 06 21:29:51 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:51 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Volume volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f (7dae2d09-afef-402a-91cd-a4ff34f8f35f): created successfully Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290f7358-9aff-4a9f-8be1-a743ee31759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Flow 'volume_create_manager' (53b963a0-7f8d-4738-967e-4d458ff08ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3dac7e90-7358-489f-8232-0ee2bdd4f034 tempest-TestServerVolumeAttachmentScenario-813906943 None] Created volume successfully. Nov 06 21:29:51 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 1073741824" returned: 0 in 0.577s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:51 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:29:51 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:52 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.312s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b0ddbb-370d-48ad-9c8f-4dcba37519cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b441ce70-55fd-45b7-8cf3-5acabbfda255', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f277f92-85e0-4331-a878-f73957847687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:52 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Volume volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 (b441ce70-55fd-45b7-8cf3-5acabbfda255): created successfully Nov 06 21:29:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f277f92-85e0-4331-a878-f73957847687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Flow 'volume_create_manager' (fb44863b-5dac-43c8-8e4f-1b913eb8ff26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-33e20511-07eb-4410-b956-b2791f298f35 tempest-VolumesActionsTest-365405546 None] Created volume successfully. Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-38b99ff9-6738-43c6-86d7-48aa2e4d4907 tempest-VolumesActionsTest-365405546 None] Acquiring lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255" by "attach_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-38b99ff9-6738-43c6-86d7-48aa2e4d4907 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255" acquired by "attach_volume" :: waited 0.040s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-38b99ff9-6738-43c6-86d7-48aa2e4d4907 tempest-VolumesActionsTest-365405546 None] Attaching volume b441ce70-55fd-45b7-8cf3-5acabbfda255 to instance 5c7c3011-5c2e-404f-ac5e-e0c90f94ee9a at mountpoint /dev/vdb on host None. Nov 06 21:30:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-38b99ff9-6738-43c6-86d7-48aa2e4d4907 tempest-VolumesActionsTest-365405546 None] Attach volume completed successfully. Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-38b99ff9-6738-43c6-86d7-48aa2e4d4907 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255" released by "attach_volume" :: held 0.160s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-428722e5-6c63-40e8-8196-2abba5ed9691 tempest-VolumesActionsTest-365405546 None] Acquiring lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-detach_volume" by "detach_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-428722e5-6c63-40e8-8196-2abba5ed9691 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-428722e5-6c63-40e8-8196-2abba5ed9691 tempest-VolumesActionsTest-365405546 None] Detaching volume b441ce70-55fd-45b7-8cf3-5acabbfda255 from instance 5c7c3011-5c2e-404f-ac5e-e0c90f94ee9a. Nov 06 21:30:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-428722e5-6c63-40e8-8196-2abba5ed9691 tempest-VolumesActionsTest-365405546 None] Detach volume completed successfully. Nov 06 21:30:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-428722e5-6c63-40e8-8196-2abba5ed9691 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:11 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:30:11 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:11 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.769s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:30:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:30:12 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:12 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:SELECT=3 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7f980f84-d8a3-43ef-8dde-77ffdaf2848b tempest-VolumesActionsTest-365405546 None] Acquiring lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255" by "attach_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7f980f84-d8a3-43ef-8dde-77ffdaf2848b tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255" acquired by "attach_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7f980f84-d8a3-43ef-8dde-77ffdaf2848b tempest-VolumesActionsTest-365405546 None] Attaching volume b441ce70-55fd-45b7-8cf3-5acabbfda255 to instance da8d8982-1d42-4335-b01c-6f9bbd5ab608 at mountpoint /dev/vdb on host None. Nov 06 21:30:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7f980f84-d8a3-43ef-8dde-77ffdaf2848b tempest-VolumesActionsTest-365405546 None] Attach volume completed successfully. Nov 06 21:30:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7f980f84-d8a3-43ef-8dde-77ffdaf2848b tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255" released by "attach_volume" :: held 0.104s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-71e83507-ba2e-419e-999f-0bc1ab37f841 tempest-VolumesActionsTest-365405546 None] Acquiring lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-detach_volume" by "detach_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-71e83507-ba2e-419e-999f-0bc1ab37f841 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-71e83507-ba2e-419e-999f-0bc1ab37f841 tempest-VolumesActionsTest-365405546 None] Detaching volume b441ce70-55fd-45b7-8cf3-5acabbfda255 from instance da8d8982-1d42-4335-b01c-6f9bbd5ab608. Nov 06 21:30:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-71e83507-ba2e-419e-999f-0bc1ab37f841 tempest-VolumesActionsTest-365405546 None] Detach volume completed successfully. Nov 06 21:30:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-71e83507-ba2e-419e-999f-0bc1ab37f841 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e832cd54-221c-4b93-82f9-0713cd97b28f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:18 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:18 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:18 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.365s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbe7c8e-6ca6-46d9-ba29-aa535e3f617a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:18 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:18 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:19 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.366s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.4b02515e-0140-4e57-bcee-f4bd4126bca1g0e0ncsl.img {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:19 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.4b02515e-0140-4e57-bcee-f4bd4126bca1g0e0ncsl.img Nov 06 21:30:19 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:25 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.4b02515e-0140-4e57-bcee-f4bd4126bca1g0e0ncsl.img" returned: 0 in 6.522s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f498fb93-bce2-4334-8afb-3a973c3b8359]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:25 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:25 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b589fa24-0ef4-4738-880a-9574494a8575 req-dc580baa-b09d-4769-87a6-990e2d427583 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:26 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.546s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:26 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.4b02515e-0140-4e57-bcee-f4bd4126bca1g0e0ncsl.img {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:30:26 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Converted 1024.00 MB image at 156.98 MB/s Nov 06 21:30:26 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] 4b02515e-0140-4e57-bcee-f4bd4126bca1 was raw, no need to convert to raw {{(pid=87450) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:30:36 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:36 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:INSERT=1,cinder:SELECT=9,cinder:UPDATE=5 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.134s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Uploaded volume to glance image-id: 4b02515e-0140-4e57-bcee-f4bd4126bca1. {{(pid=87450) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 21:30:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b589fa24-0ef4-4738-880a-9574494a8575 req-dc580baa-b09d-4769-87a6-990e2d427583 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.518s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-b589fa24-0ef4-4738-880a-9574494a8575 req-dc580baa-b09d-4769-87a6-990e2d427583 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ec7c389d-48d7-413b-9ed0-bfc98213e35b tempest-VolumesActionsTest-365405546 None] Copy volume to image completed successfully. Nov 06 21:30:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-b589fa24-0ef4-4738-880a-9574494a8575 req-dc580baa-b09d-4769-87a6-990e2d427583 tempest-TestServerVolumeAttachmentScenario-813906943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '810caa9e-8567-4a5f-b051-7bcf429abeab', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:30:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-b589fa24-0ef4-4738-880a-9574494a8575 req-dc580baa-b09d-4769-87a6-990e2d427583 tempest-TestServerVolumeAttachmentScenario-813906943 None] attachment_update completed successfully. Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9388089-a0a1-4541-886a-fd17e5107bec]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:47 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:47 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:47 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.388s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41cd5c-dae0-4638-a270-222f6a205ceb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:47 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:47 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.385s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:47 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:47 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img Nov 06 21:30:47 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-2bf4aef1-7bbc-43e1-ab54-7b2206efd209 req-30d55c46-fd43-4539-bda8-10e1f927f216 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:54 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img" returned: 0 in 6.129s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[906402e4-2a77-4df8-8de2-1922d03dfe1a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:54 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:54 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:54 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.545s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:30:54 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Converted 1024.00 MB image at 167.03 MB/s Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] 8e327a53-6b1d-47bb-ab31-ea324d774134 was raw, converting to qcow2 {{(pid=87450) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1197}} Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f0c932-b5ad-418a-bca7-c14eda47030e]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:54 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img Nov 06 21:30:54 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:55 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img" returned: 0 in 0.328s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:55 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img Nov 06 21:30:55 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:55 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img" returned: 1 in 0.322s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img /opt/stack/data/cinder/conversion/vol_upload_q8r8vqvy {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:55 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img /opt/stack/data/cinder/conversion/vol_upload_q8r8vqvy Nov 06 21:30:55 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:55 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img /opt/stack/data/cinder/conversion/vol_upload_q8r8vqvy" returned: 0 in 0.269s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Image conversion details: src /opt/stack/data/cinder/conversion/b441ce70-55fd-45b7-8cf3-5acabbfda255.temp_image.8e327a53-6b1d-47bb-ab31-ea324d774134ho7wzmck.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_q8r8vqvy {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:30:55 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[689bd8df-0748-4093-b777-ae516f91876a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q8r8vqvy {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:55 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q8r8vqvy Nov 06 21:30:55 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:55 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q8r8vqvy" returned: 0 in 0.324s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.988s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Uploaded volume to glance image-id: 8e327a53-6b1d-47bb-ab31-ea324d774134. {{(pid=87450) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 21:30:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-2bf4aef1-7bbc-43e1-ab54-7b2206efd209 req-30d55c46-fd43-4539-bda8-10e1f927f216 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.092s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-2bf4aef1-7bbc-43e1-ab54-7b2206efd209 req-30d55c46-fd43-4539-bda8-10e1f927f216 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:57 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f6fed010-6b8e-4b69-9015-1886c724e0ad tempest-VolumesActionsTest-365405546 None] Copy volume to image completed successfully. Nov 06 21:30:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-2bf4aef1-7bbc-43e1-ab54-7b2206efd209 req-30d55c46-fd43-4539-bda8-10e1f927f216 tempest-TestServerVolumeAttachmentScenario-813906943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b048dd42-7606-4100-9c5a-3debe6df599d', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:30:57 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-2bf4aef1-7bbc-43e1-ab54-7b2206efd209 req-30d55c46-fd43-4539-bda8-10e1f927f216 tempest-TestServerVolumeAttachmentScenario-813906943 None] attachment_update completed successfully. Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Acquiring lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Acquiring lock "cinder-quobyte-b441ce70-55fd-45b7-8cf3-5acabbfda255" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Lock "cinder-quobyte-b441ce70-55fd-45b7-8cf3-5acabbfda255" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f680b0-e7c9-4ba1-b70e-07ee28c804d7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:58 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:58 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:58 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:58 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255 Nov 06 21:30:58 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-e87102ee-4711-4c17-962a-9e412683b224 req-10d5d6d4-29aa-463d-9e3b-64b16f34df8f tempest-TestServerVolumeAttachmentScenario-813906943 None] Terminate volume connection completed successfully. Nov 06 21:30:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-e87102ee-4711-4c17-962a-9e412683b224 req-10d5d6d4-29aa-463d-9e3b-64b16f34df8f tempest-TestServerVolumeAttachmentScenario-813906943 None] Deleting attachment b048dd42-7606-4100-9c5a-3debe6df599d. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:30:59 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b441ce70-55fd-45b7-8cf3-5acabbfda255" returned: 0 in 0.281s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Lock "cinder-quobyte-b441ce70-55fd-45b7-8cf3-5acabbfda255" released by "delete_volume" :: held 0.733s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Created reservations ['9909f42e-304c-46fd-b675-46e66fb5a7f5', 'a02ccf99-1f59-45c0-9b94-01917365e8a9', '5b198df2-8357-4bd0-a236-2768deeae538', 'd98d69f6-a335-487b-a64d-c4435782c352'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:59 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:30:59 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:59 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.308s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Deleted volume successfully. Nov 06 21:30:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b701e355-839d-41b3-9442-efe455eb5795 tempest-VolumesActionsTest-365405546 None] Lock "cinder-b441ce70-55fd-45b7-8cf3-5acabbfda255-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-e3fc9c1f-d8d2-453e-a05c-45b7a104c6af req-82bd692b-b510-4a04-ac47-23cfefdc0256 tempest-TestServerVolumeAttachmentScenario-813906943 None] Terminate volume connection completed successfully. Nov 06 21:31:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-e3fc9c1f-d8d2-453e-a05c-45b7a104c6af req-82bd692b-b510-4a04-ac47-23cfefdc0256 tempest-TestServerVolumeAttachmentScenario-813906943 None] Deleting attachment 810caa9e-8567-4a5f-b051-7bcf429abeab. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "cinder-7dae2d09-afef-402a-91cd-a4ff34f8f35f-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-7dae2d09-afef-402a-91cd-a4ff34f8f35f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "cinder-quobyte-7dae2d09-afef-402a-91cd-a4ff34f8f35f" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-quobyte-7dae2d09-afef-402a-91cd-a4ff34f8f35f" acquired by "delete_volume" :: waited 0.032s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[37250f4e-765a-44d4-a379-77980713e98b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:06 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f Nov 06 21:31:06 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:06 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f" returned: 0 in 0.379s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:06 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f Nov 06 21:31:06 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:07 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-7dae2d09-afef-402a-91cd-a4ff34f8f35f" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-quobyte-7dae2d09-afef-402a-91cd-a4ff34f8f35f" released by "delete_volume" :: held 0.685s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Created reservations ['1024c82d-6752-4582-b9da-f37f122439ba', 'dafc1e1a-5c62-4d62-8c33-b5672a401847', '0626d9e4-6294-45a2-acf0-f992bcd8fdc0', '908214cd-ae9a-47df-bc32-2f6f0432b440'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:07 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:07 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:07 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Deleted volume successfully. Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0fd36037-c35a-49fc-95ee-4d4541b99e2d tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-7dae2d09-afef-402a-91cd-a4ff34f8f35f-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "cinder-1677ad7d-1ddd-4188-8aa5-4b6270931f63-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-1677ad7d-1ddd-4188-8aa5-4b6270931f63-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "cinder-quobyte-1677ad7d-1ddd-4188-8aa5-4b6270931f63" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-quobyte-1677ad7d-1ddd-4188-8aa5-4b6270931f63" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f54b7d7-2b3d-49df-bf96-f6c279f88e48]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:07 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 Nov 06 21:31:07 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:08 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63" returned: 0 in 0.377s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:08 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63 Nov 06 21:31:08 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:08 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-1677ad7d-1ddd-4188-8aa5-4b6270931f63" returned: 0 in 0.273s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-quobyte-1677ad7d-1ddd-4188-8aa5-4b6270931f63" released by "delete_volume" :: held 0.705s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Created reservations ['cfa65d01-e928-4bde-8e97-ee88814f1b69', 'fa833b5a-e151-4723-8b01-2673aa72b45d', '0ba230fb-67c2-4b4b-8a81-bd95c96655e5', '78b1983d-3af9-437a-a9f9-c9a716f2c4c7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Flow 'volume_create_manager' (39a2db6d-4eb1-4c2a-8459-ef034cb141fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3c144e-5bbd-46b1-913b-f24746df71c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3c144e-5bbd-46b1-913b-f24746df71c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-402331917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dafaee2-0aa7-407c-9106-981b725f236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='319ff02c45de4349add1a0b55057c74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:08Z,use_quota=True,user_id='26b7383125a8457a89167f965f7a308c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e54f22-57e0-4312-99e3-74ac20ab5459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e54f22-57e0-4312-99e3-74ac20ab5459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d54e1-0deb-41e3-9cfe-3810b538939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d54e1-0deb-41e3-9cfe-3810b538939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dafaee2-0aa7-407c-9106-981b725f236d', 'volume_name': 'volume-4dafaee2-0aa7-407c-9106-981b725f236d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f94690-dea0-4b3a-979c-afbba30477df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f94690-dea0-4b3a-979c-afbba30477df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947be7f4-50a3-4d7a-a6e3-acf94cea4dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Volume 4dafaee2-0aa7-407c-9106-981b725f236d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dafaee2-0aa7-407c-9106-981b725f236d', 'volume_size': 1} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-402331917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dafaee2-0aa7-407c-9106-981b725f236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='319ff02c45de4349add1a0b55057c74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:08Z,use_quota=True,user_id='26b7383125a8457a89167f965f7a308c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Creating volume 4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:08 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:08 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d 1073741824 Nov 06 21:31:08 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:08 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:08 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:08 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.278s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Deleted volume successfully. Nov 06 21:31:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9cfa246d-3337-4463-b756-bfae875980d4 tempest-TestServerVolumeAttachmentScenario-813906943 None] Lock "cinder-1677ad7d-1ddd-4188-8aa5-4b6270931f63-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:09 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d 1073741824" returned: 0 in 0.519s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:09 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d Nov 06 21:31:09 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:09 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d" returned: 0 in 0.282s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947be7f4-50a3-4d7a-a6e3-acf94cea4dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dafaee2-0aa7-407c-9106-981b725f236d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22504984-08c2-42de-a142-9c3d222abef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:09 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Volume volume-4dafaee2-0aa7-407c-9106-981b725f236d (4dafaee2-0aa7-407c-9106-981b725f236d): created successfully Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22504984-08c2-42de-a142-9c3d222abef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Flow 'volume_create_manager' (39a2db6d-4eb1-4c2a-8459-ef034cb141fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3322907e-334f-4898-a08d-42ba8b187db7 tempest-VolumesCloneTest-1844470748 None] Created volume successfully. Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Flow 'volume_create_manager' (5e06c16b-7f6a-4e7f-8822-3760b7a8175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b24a6c-98c0-4ac8-9304-ce107262ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b24a6c-98c0-4ac8-9304-ce107262ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1131675454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36034526-9843-4052-b25b-cf7c1326df61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='319ff02c45de4349add1a0b55057c74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4dafaee2-0aa7-407c-9106-981b725f236d,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:11Z,use_quota=True,user_id='26b7383125a8457a89167f965f7a308c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d69cb2-d929-4d45-92e0-d4018584e503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:11 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d69cb2-d929-4d45-92e0-d4018584e503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7874846-b4b6-4485-8897-0437eebadc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7874846-b4b6-4485-8897-0437eebadc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '36034526-9843-4052-b25b-cf7c1326df61', 'volume_name': 'volume-36034526-9843-4052-b25b-cf7c1326df61', 'volume_size': 2, 'source_volid': '4dafaee2-0aa7-407c-9106-981b725f236d', 'source_volstatus': 'available'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340ef588-2a77-44f3-85f4-b39bc476b43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340ef588-2a77-44f3-85f4-b39bc476b43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc977e6-35f2-4dd4-aabd-5d21eb66ec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Volume 36034526-9843-4052-b25b-cf7c1326df61: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-36034526-9843-4052-b25b-cf7c1326df61', 'volume_size': 2, 'source_volid': '4dafaee2-0aa7-407c-9106-981b725f236d', 'source_volstatus': 'available'} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:11 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Cloning volume 4dafaee2-0aa7-407c-9106-981b725f236d to volume 36034526-9843-4052-b25b-cf7c1326df61 Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Creating offline snapshot 8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf of volume 4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ea639c-a428-4613-be6e-499e89e39602]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:11 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d Nov 06 21:31:11 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:11 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:31:11 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d" returned: 0 in 0.424s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:11 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf 1G Nov 06 21:31:11 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:12 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf 1G" returned: 0 in 0.458s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dafaee2-0aa7-407c-9106-981b725f236d -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:12 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dafaee2-0aa7-407c-9106-981b725f236d -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf Nov 06 21:31:12 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:12 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dafaee2-0aa7-407c-9106-981b725f236d -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" returned: 0 in 0.351s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:12 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf is being set with open permissions: ugo+rw Nov 06 21:31:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:12 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf Nov 06 21:31:12 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:12 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" returned: 0 in 0.272s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:12 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.info Nov 06 21:31:12 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:13 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.info" returned: 0 in 0.304s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:13 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.info is being set with open permissions: ugo+rw Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:13 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.info Nov 06 21:31:13 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:13 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.info" returned: 0 in 0.286s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Acquiring lock "cinder-quobyte-36034526-9843-4052-b25b-cf7c1326df61" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-36034526-9843-4052-b25b-cf7c1326df61" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] snapshot: 8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf, volume: 36034526-9843-4052-b25b-cf7c1326df61, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[859d2da8-6d36-49b9-8a6d-a9a065c84484]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:13 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf Nov 06 21:31:13 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:13 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" returned: 0 in 0.393s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dafaee2-0aa7-407c-9106-981b725f236d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a3137-457a-4bc0-9b2d-8fdfb61856af]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:14 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d Nov 06 21:31:14 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:14 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d" returned: 0 in 0.389s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:31:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:31:14 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:31:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:14 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 Nov 06 21:31:14 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:21 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61" returned: 0 in 6.907s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:31:21 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Converted 1024.00 MB image at 148.23 MB/s Nov 06 21:31:21 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 is being set with open permissions: ugo+rw Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:21 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 Nov 06 21:31:21 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:21 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61" returned: 0 in 0.249s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-36034526-9843-4052-b25b-cf7c1326df61" released by "_copy_volume_from_snapshot" :: held 8.018s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Acquiring lock "cinder-quobyte-8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Deleting offline snapshot 8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf of volume 4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] snapshot_file for this snap is: volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd7c54e-4325-4ffd-8375-60945a628cc8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:21 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf Nov 06 21:31:21 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:21 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" returned: 0 in 0.379s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dafaee2-0aa7-407c-9106-981b725f236d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5a9fd9-1ccc-48a7-b75f-06e4e2459401]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:22 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d Nov 06 21:31:22 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:22 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d" returned: 0 in 0.572s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:22 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf Nov 06 21:31:22 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:22 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=37,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:22 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" returned: 0 in 0.362s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:22 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf Nov 06 21:31:22 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:23 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d.8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" returned: 0 in 0.268s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-8ed7c9fd-37df-4d7d-9b1f-20e5d8feb5cf" released by "_delete_snapshot" :: held 1.716s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.037s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc977e6-35f2-4dd4-aabd-5d21eb66ec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36034526-9843-4052-b25b-cf7c1326df61', 'volume_size': 2, 'source_volid': '4dafaee2-0aa7-407c-9106-981b725f236d', 'source_volstatus': 'available'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fbcd16-dd48-4de7-94b6-880acc668d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Volume volume-36034526-9843-4052-b25b-cf7c1326df61 (36034526-9843-4052-b25b-cf7c1326df61): created successfully Nov 06 21:31:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fbcd16-dd48-4de7-94b6-880acc668d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Flow 'volume_create_manager' (5e06c16b-7f6a-4e7f-8822-3760b7a8175c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-aaeab452-15f5-49b3-9ed1-a75cb026d534 tempest-VolumesCloneTest-1844470748 None] Created volume successfully. Nov 06 21:31:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Acquiring lock "cinder-36034526-9843-4052-b25b-cf7c1326df61-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Lock "cinder-36034526-9843-4052-b25b-cf7c1326df61-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Acquiring lock "cinder-quobyte-36034526-9843-4052-b25b-cf7c1326df61" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-36034526-9843-4052-b25b-cf7c1326df61" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4b100-e21c-4d66-a949-dd9a2054b256]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:24 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 Nov 06 21:31:24 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61" returned: 0 in 0.397s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:25 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61 Nov 06 21:31:25 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-36034526-9843-4052-b25b-cf7c1326df61" returned: 0 in 0.269s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-36034526-9843-4052-b25b-cf7c1326df61" released by "delete_volume" :: held 0.722s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Created reservations ['5e96dc8c-e4ab-408a-9db6-398e667e064a', '49e69947-a067-4afb-a14e-4a0b91f8a8f7', '60b11c1c-3a6c-4192-8591-ec34821044e8', '17c4f187-592e-4081-9ed6-7363473bebb2'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:25 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:25 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.274s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Deleted volume successfully. Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-7b4fc3d1-6b27-4905-bad5-e3d3b4fd8e8a tempest-VolumesCloneTest-1844470748 None] Lock "cinder-36034526-9843-4052-b25b-cf7c1326df61-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Acquiring lock "cinder-4dafaee2-0aa7-407c-9106-981b725f236d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Lock "cinder-4dafaee2-0aa7-407c-9106-981b725f236d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Acquiring lock "cinder-quobyte-4dafaee2-0aa7-407c-9106-981b725f236d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-4dafaee2-0aa7-407c-9106-981b725f236d" acquired by "delete_volume" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[841fa7a1-86d2-48a8-8b41-b6f78bd861d0]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:26 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d Nov 06 21:31:26 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:26 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d" returned: 0 in 0.389s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:26 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d Nov 06 21:31:26 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:26 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4dafaee2-0aa7-407c-9106-981b725f236d" returned: 0 in 0.273s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Lock "cinder-quobyte-4dafaee2-0aa7-407c-9106-981b725f236d" released by "delete_volume" :: held 0.746s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Created reservations ['05fbbb73-9d2f-4fd9-9b14-a9baa9aa3872', 'c9fbd08a-eeb1-41d2-bea1-4a0f3f2cb136', '188beb81-563b-4dfb-9364-3256052ffd82', 'c038a9d0-0f2c-4fe4-a56c-6efa518fa4bc'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:26 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:26 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:27 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.269s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:27 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Deleted volume successfully. Nov 06 21:31:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ad180317-6dca-403c-8136-b8caffda32ab tempest-VolumesCloneTest-1844470748 None] Lock "cinder-4dafaee2-0aa7-407c-9106-981b725f236d-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Flow 'volume_create_manager' (ac752a83-4c00-454c-8291-64fee59ec2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496db028-1c55-4cdb-9417-0bb99fd4484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496db028-1c55-4cdb-9417-0bb99fd4484b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-710170249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29d9971-d705-4e9f-aea4-316f5ed0a0c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bf1455d66544024889a2c989e0af243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:36Z,use_quota=True,user_id='53a2a1e36be841b6bdb262d2e3c19d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7123c0e5-a5aa-48ba-b351-79de868904a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7123c0e5-a5aa-48ba-b351-79de868904a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a975106-53d2-4e52-947c-5eb65328d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a975106-53d2-4e52-947c-5eb65328d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29d9971-d705-4e9f-aea4-316f5ed0a0c1', 'volume_name': 'volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d976472d-aba5-4727-a30c-aa3f84065d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d976472d-aba5-4727-a30c-aa3f84065d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d392a4c1-ec5a-40fb-abeb-fd9b6f01966c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Volume c29d9971-d705-4e9f-aea4-316f5ed0a0c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1', 'volume_size': 1} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-710170249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29d9971-d705-4e9f-aea4-316f5ed0a0c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bf1455d66544024889a2c989e0af243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:36Z,use_quota=True,user_id='53a2a1e36be841b6bdb262d2e3c19d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Creating volume c29d9971-d705-4e9f-aea4-316f5ed0a0c1 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:35 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:31:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:35 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 1073741824 Nov 06 21:31:35 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:36 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 1073741824" returned: 0 in 0.487s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=49,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:36 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 Nov 06 21:31:36 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:36 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1" returned: 0 in 0.255s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d392a4c1-ec5a-40fb-abeb-fd9b6f01966c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176b415-85ae-421d-90df-0b435c0e2a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Volume volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 (c29d9971-d705-4e9f-aea4-316f5ed0a0c1): created successfully Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176b415-85ae-421d-90df-0b435c0e2a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Flow 'volume_create_manager' (ac752a83-4c00-454c-8291-64fee59ec2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7950874a-cc92-4a15-8a59-3dd1b2cb0abc tempest-VolumesListTestJSON-652138748 None] Created volume successfully. Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Flow 'volume_create_manager' (db4919ec-8951-44d3-bf69-5e712d88c0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b9271-c2c2-4bcb-b3f6-a343fd69d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b9271-c2c2-4bcb-b3f6-a343fd69d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1586969782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ffef82-f267-40e8-a3dd-c51b96f29836,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bf1455d66544024889a2c989e0af243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:39Z,use_quota=True,user_id='53a2a1e36be841b6bdb262d2e3c19d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93570884-5ad2-45d6-bfdb-9677da6fa52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93570884-5ad2-45d6-bfdb-9677da6fa52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea95a6b9-1c9b-4f43-b111-c5a4b0b7b7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea95a6b9-1c9b-4f43-b111-c5a4b0b7b7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ffef82-f267-40e8-a3dd-c51b96f29836', 'volume_name': 'volume-f9ffef82-f267-40e8-a3dd-c51b96f29836', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fca3969-b50e-4116-922f-c203adc2d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fca3969-b50e-4116-922f-c203adc2d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ece25a-9c49-494e-9880-07813f5f045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Volume f9ffef82-f267-40e8-a3dd-c51b96f29836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ffef82-f267-40e8-a3dd-c51b96f29836', 'volume_size': 1} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1586969782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ffef82-f267-40e8-a3dd-c51b96f29836,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bf1455d66544024889a2c989e0af243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:39Z,use_quota=True,user_id='53a2a1e36be841b6bdb262d2e3c19d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Creating volume f9ffef82-f267-40e8-a3dd-c51b96f29836 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:38 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:31:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:38 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 1073741824 Nov 06 21:31:38 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:39 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 1073741824" returned: 0 in 0.486s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:39 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 Nov 06 21:31:39 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:39 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836" returned: 0 in 0.290s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ece25a-9c49-494e-9880-07813f5f045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ffef82-f267-40e8-a3dd-c51b96f29836', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e385248-29ea-483b-a77e-27cb79913672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Volume volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 (f9ffef82-f267-40e8-a3dd-c51b96f29836): created successfully Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e385248-29ea-483b-a77e-27cb79913672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Flow 'volume_create_manager' (db4919ec-8951-44d3-bf69-5e712d88c0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:39 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-58c742cc-b2ca-4e5b-bb2d-2903bcd56331 tempest-VolumesListTestJSON-652138748 None] Created volume successfully. Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Flow 'volume_create_manager' (30b09484-2bd7-4e83-a74f-28e4f95f81a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8791fd2-6d56-4938-98ed-e8ca2bb332b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8791fd2-6d56-4938-98ed-e8ca2bb332b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-916699394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35354d6-c07c-4fd9-8933-07342412d773,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bf1455d66544024889a2c989e0af243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:41Z,use_quota=True,user_id='53a2a1e36be841b6bdb262d2e3c19d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487ef9a7-701d-4171-82f6-886382dbc6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487ef9a7-701d-4171-82f6-886382dbc6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e4b14c-e645-4874-b5c6-b3ce76694b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e4b14c-e645-4874-b5c6-b3ce76694b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35354d6-c07c-4fd9-8933-07342412d773', 'volume_name': 'volume-e35354d6-c07c-4fd9-8933-07342412d773', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71cef5e-e6f8-49b9-b1a1-84fa256e7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71cef5e-e6f8-49b9-b1a1-84fa256e7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b849bf85-5308-4787-8480-421bf1d9fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:41 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Volume e35354d6-c07c-4fd9-8933-07342412d773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35354d6-c07c-4fd9-8933-07342412d773', 'volume_size': 1} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-916699394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35354d6-c07c-4fd9-8933-07342412d773,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bf1455d66544024889a2c989e0af243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:41Z,use_quota=True,user_id='53a2a1e36be841b6bdb262d2e3c19d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Creating volume e35354d6-c07c-4fd9-8933-07342412d773 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:41 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:41 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 1073741824 Nov 06 21:31:41 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:41 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 1073741824" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:41 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 Nov 06 21:31:41 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:42 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773" returned: 0 in 0.265s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b849bf85-5308-4787-8480-421bf1d9fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35354d6-c07c-4fd9-8933-07342412d773', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6ba411-e593-44bb-84d8-016f2a2fe519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:42 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Volume volume-e35354d6-c07c-4fd9-8933-07342412d773 (e35354d6-c07c-4fd9-8933-07342412d773): created successfully Nov 06 21:31:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6ba411-e593-44bb-84d8-016f2a2fe519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:42 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Flow 'volume_create_manager' (30b09484-2bd7-4e83-a74f-28e4f95f81a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a1cb8235-0dca-432b-95d0-4ed4383a0212 tempest-VolumesListTestJSON-652138748 None] Created volume successfully. Nov 06 21:31:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Acquiring lock "cinder-e35354d6-c07c-4fd9-8933-07342412d773-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Lock "cinder-e35354d6-c07c-4fd9-8933-07342412d773-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Acquiring lock "cinder-quobyte-e35354d6-c07c-4fd9-8933-07342412d773" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Lock "cinder-quobyte-e35354d6-c07c-4fd9-8933-07342412d773" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:45 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197301a-b46e-40b0-afbc-2d55b5652671]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:45 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 Nov 06 21:31:45 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:46 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773" returned: 0 in 0.402s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:46 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773 Nov 06 21:31:46 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:46 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e35354d6-c07c-4fd9-8933-07342412d773" returned: 0 in 0.265s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Lock "cinder-quobyte-e35354d6-c07c-4fd9-8933-07342412d773" released by "delete_volume" :: held 0.718s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Created reservations ['ea859e69-b042-4c50-96d6-d56e52422df7', 'a4dcd147-206b-49dc-85a2-23547ea8f0e4', '751447b2-582e-416f-9e14-c17ce39f223f', 'd2462a50-9ae6-466c-a4a6-2f549ef50919'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:46 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:46 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:46 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.285s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Acquiring lock "cinder-f9ffef82-f267-40e8-a3dd-c51b96f29836-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Deleted volume successfully. Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Lock "cinder-f9ffef82-f267-40e8-a3dd-c51b96f29836-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-91122f1c-1c85-40b4-9b28-2ec6cd7256ed tempest-VolumesListTestJSON-652138748 None] Lock "cinder-e35354d6-c07c-4fd9-8933-07342412d773-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Acquiring lock "cinder-quobyte-f9ffef82-f267-40e8-a3dd-c51b96f29836" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Lock "cinder-quobyte-f9ffef82-f267-40e8-a3dd-c51b96f29836" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e0d216-8fa7-43de-9ac3-aa24aca057e4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:47 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 Nov 06 21:31:47 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:47 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836" returned: 0 in 0.443s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:47 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836 Nov 06 21:31:47 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:47 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-f9ffef82-f267-40e8-a3dd-c51b96f29836" returned: 0 in 0.276s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Lock "cinder-quobyte-f9ffef82-f267-40e8-a3dd-c51b96f29836" released by "delete_volume" :: held 0.772s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Created reservations ['0c513e2b-eb6f-4868-b06e-579ddfc3d36d', 'c3752823-b0b2-455e-9795-08b034b66757', '64bb3d2c-2677-4be5-83d3-d3fd1865de1e', '2aaf315c-e7d9-4788-af54-fef86dff63cc'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:47 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:47 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Acquiring lock "cinder-c29d9971-d705-4e9f-aea4-316f5ed0a0c1-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Lock "cinder-c29d9971-d705-4e9f-aea4-316f5ed0a0c1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Acquiring lock "cinder-quobyte-c29d9971-d705-4e9f-aea4-316f5ed0a0c1" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Lock "cinder-quobyte-c29d9971-d705-4e9f-aea4-316f5ed0a0c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:48 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.331s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Deleted volume successfully. Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0fcd5a-f381-49ee-846b-e85f96d4c3f8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-729c1f88-2f8e-444e-b06d-1833ab0f2f7d tempest-VolumesListTestJSON-652138748 None] Lock "cinder-f9ffef82-f267-40e8-a3dd-c51b96f29836-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:48 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 Nov 06 21:31:48 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:48 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1" returned: 0 in 0.394s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:48 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1 Nov 06 21:31:48 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:48 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c29d9971-d705-4e9f-aea4-316f5ed0a0c1" returned: 0 in 0.271s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Lock "cinder-quobyte-c29d9971-d705-4e9f-aea4-316f5ed0a0c1" released by "delete_volume" :: held 0.733s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Created reservations ['e405e17f-49ae-45f5-893b-992870c65724', 'a107047d-8ff5-4b07-b6dc-5bb0728970d9', '839eff49-c711-43e4-8a23-24b64368875f', '0991523b-67d5-44d0-97f0-a351ef124f6a'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:49 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:31:49 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:49 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.285s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:49 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Deleted volume successfully. Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-154a29ac-be81-4458-aa32-870d0bd344ad tempest-VolumesListTestJSON-652138748 None] Lock "cinder-c29d9971-d705-4e9f-aea4-316f5ed0a0c1-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Flow 'volume_create_manager' (7f371939-c76c-4ab7-b97a-9f318bc2f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131fb5a3-233d-4f83-aeb3-7a207b418f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131fb5a3-233d-4f83-aeb3-7a207b418f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-745888006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5762d68a-c155-432d-95d9-7039da00472f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e040bca719844588b146ef78a2b3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:50Z,use_quota=True,user_id='51fb62b754564b059953075ec0c06f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35f9d25-364e-4955-a97c-b1217b3ab4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35f9d25-364e-4955-a97c-b1217b3ab4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae93380-8344-4223-8af9-62156847f578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae93380-8344-4223-8af9-62156847f578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5762d68a-c155-432d-95d9-7039da00472f', 'volume_name': 'volume-5762d68a-c155-432d-95d9-7039da00472f', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0830af2a-e9d9-4bd2-bef8-824eca9ab424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0830af2a-e9d9-4bd2-bef8-824eca9ab424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0185491c-0ee1-4518-8329-1ea885bbb71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:50 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Volume 5762d68a-c155-432d-95d9-7039da00472f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5762d68a-c155-432d-95d9-7039da00472f', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Trying to clone 5762d68a-c155-432d-95d9-7039da00472f from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:31:50 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e11b94-cc76-44eb-b298-f8bca7e96140]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:50 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD Nov 06 21:31:50 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:50 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 is fetched for user 51fb62b754564b059953075ec0c06f3c. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb34e3-7167-43d1-ad8a-cae7a3cb72da]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:51 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD Nov 06 21:31:51 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:51 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-745888006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5762d68a-c155-432d-95d9-7039da00472f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e040bca719844588b146ef78a2b3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:50Z,use_quota=True,user_id='51fb62b754564b059953075ec0c06f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Creating volume 5762d68a-c155-432d-95d9-7039da00472f {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:51 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:51 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f 1073741824 Nov 06 21:31:51 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:51 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f 1073741824" returned: 0 in 0.497s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:51 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f Nov 06 21:31:51 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:52 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f" returned: 0 in 0.254s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Attempting download of 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume 5762d68a-c155-432d-95d9-7039da00472f. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c552259-dd78-4d8b-b082-fceb8fec06dd]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_bxg_0fp8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:52 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_bxg_0fp8 Nov 06 21:31:52 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:52 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_bxg_0fp8" returned: 0 in 0.391s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_bxg_0fp8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:52 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_bxg_0fp8 Nov 06 21:31:52 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:52 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_bxg_0fp8" returned: 1 in 0.365s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c7c38c6-44d6-4400-a543-dd1512f9cf56_bxg_0fp8' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2c0f1-f41b-4a7d-a864-5d5aa19d9bd5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:53 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD Nov 06 21:31:53 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:53 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:53 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] 8c7c38c6-44d6-4400-a543-dd1512f9cf56 was qcow2, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:31:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:53 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f Nov 06 21:31:53 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:55 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f" returned: 0 in 2.154s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c7c38c6-44d6-4400-a543-dd1512f9cf56_1kjqa9ofdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:31:55 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Converted 112.00 MB image at 51.97 MB/s Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:55 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f 1G Nov 06 21:31:55 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:55 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f 1G" returned: 0 in 0.370s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Downloaded image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}])) to volume 5762d68a-c155-432d-95d9-7039da00472f successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Temporary image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 for user 51fb62b754564b059953075ec0c06f3c is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Marking volume 5762d68a-c155-432d-95d9-7039da00472f as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Copying metadata from image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 to 5762d68a-c155-432d-95d9-7039da00472f. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Creating volume glance metadata for volume 5762d68a-c155-432d-95d9-7039da00472f backed by image 8c7c38c6-44d6-4400-a543-dd1512f9cf56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0185491c-0ee1-4518-8329-1ea885bbb71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5762d68a-c155-432d-95d9-7039da00472f', 'volume_size': 1, 'image_id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6dccb6a5fd04ba6aad8601bd408d6f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c7c38c6-44d6-4400-a543-dd1512f9cf56', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c7c38c6-44d6-4400-a543-dd1512f9cf56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc0679a-8820-4338-a7d3-9d0d44a41482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:55 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Volume volume-5762d68a-c155-432d-95d9-7039da00472f (5762d68a-c155-432d-95d9-7039da00472f): created successfully Nov 06 21:31:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc0679a-8820-4338-a7d3-9d0d44a41482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Flow 'volume_create_manager' (7f371939-c76c-4ab7-b97a-9f318bc2f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:56 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-902e09ef-5ac7-4408-8b7f-3b364e6068a7 tempest-TestShelveInstance-1062230741 None] Created volume successfully. Nov 06 21:32:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-4481c934-c855-47b2-80af-3519e77d0ec4 req-2c4ef550-3224-4b91-91a7-ebefb2639018 tempest-TestShelveInstance-1062230741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-4481c934-c855-47b2-80af-3519e77d0ec4 req-2c4ef550-3224-4b91-91a7-ebefb2639018 tempest-TestShelveInstance-1062230741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-4481c934-c855-47b2-80af-3519e77d0ec4 req-2c4ef550-3224-4b91-91a7-ebefb2639018 tempest-TestShelveInstance-1062230741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-4481c934-c855-47b2-80af-3519e77d0ec4 req-2c4ef550-3224-4b91-91a7-ebefb2639018 tempest-TestShelveInstance-1062230741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-5762d68a-c155-432d-95d9-7039da00472f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65231900-0015-4f0d-a66f-1fcfaf6fadf9', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:32:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-4481c934-c855-47b2-80af-3519e77d0ec4 req-2c4ef550-3224-4b91-91a7-ebefb2639018 tempest-TestShelveInstance-1062230741 None] attachment_update completed successfully. Nov 06 21:32:10 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:DELETE=4,cinder:UPDATE=40,cinder:SELECT=34,cinder:INSERT=12 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:10 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=53,cinder:SELECT=51,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:11 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:32:11 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:11 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.400s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:32:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Flow 'volume_create_manager' (9816e822-32f0-4de9-b391-79c857bc764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82c1044-b59b-443c-ab4d-eb83f6ee45e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82c1044-b59b-443c-ab4d-eb83f6ee45e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1042389972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0317f4-bd05-4785-b5a1-10d77275dbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d385f3b67df84baf851fb6d22f73da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:32:17Z,use_quota=True,user_id='ad99b680936c4c66840c71b340521335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aac4fb3-3ca6-4b0c-a2d6-8b752181a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aac4fb3-3ca6-4b0c-a2d6-8b752181a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70660840-a4cb-4e75-84a6-8c8bac9dc48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70660840-a4cb-4e75-84a6-8c8bac9dc48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0317f4-bd05-4785-b5a1-10d77275dbd3', 'volume_name': 'volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764c0877-ba06-45ad-bf8f-c2b52fff792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764c0877-ba06-45ad-bf8f-c2b52fff792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5b7591-61e1-4cf0-a2e9-34f42250a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:32:17 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Volume 9d0317f4-bd05-4785-b5a1-10d77275dbd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3', 'volume_size': 1} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1042389972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0317f4-bd05-4785-b5a1-10d77275dbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d385f3b67df84baf851fb6d22f73da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:32:17Z,use_quota=True,user_id='ad99b680936c4c66840c71b340521335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Creating volume 9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:32:17 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:32:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:17 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 1073741824 Nov 06 21:32:17 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:18 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 1073741824" returned: 0 in 0.520s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:18 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 Nov 06 21:32:18 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:18 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3" returned: 0 in 0.319s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5b7591-61e1-4cf0-a2e9-34f42250a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b828f50-daa5-458e-bf45-8e859ca5c0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:32:18 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Volume volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 (9d0317f4-bd05-4785-b5a1-10d77275dbd3): created successfully Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b828f50-daa5-458e-bf45-8e859ca5c0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:32:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Flow 'volume_create_manager' (9816e822-32f0-4de9-b391-79c857bc764c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:32:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5b9d164c-6559-4169-9580-93d933170da5 tempest-TestStampPattern-1408597911 None] Created volume successfully. Nov 06 21:32:32 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:32 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-56b0618d-f56b-4f96-a9ae-350ad2478f3d req-b18db652-9f49-4bc8-a769-198102725291 tempest-TestShelveInstance-1062230741 None] Terminate volume connection completed successfully. Nov 06 21:32:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-56b0618d-f56b-4f96-a9ae-350ad2478f3d req-b18db652-9f49-4bc8-a769-198102725291 tempest-TestShelveInstance-1062230741 None] Deleting attachment 65231900-0015-4f0d-a66f-1fcfaf6fadf9. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:32:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-a5e256e9-037e-4e46-9a2d-a16249f9f7c6 req-f9f773f3-b0ee-414c-b875-ed0cc8c6432d tempest-TestShelveInstance-1062230741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-a5e256e9-037e-4e46-9a2d-a16249f9f7c6 req-f9f773f3-b0ee-414c-b875-ed0cc8c6432d tempest-TestShelveInstance-1062230741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-a5e256e9-037e-4e46-9a2d-a16249f9f7c6 req-f9f773f3-b0ee-414c-b875-ed0cc8c6432d tempest-TestShelveInstance-1062230741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-a5e256e9-037e-4e46-9a2d-a16249f9f7c6 req-f9f773f3-b0ee-414c-b875-ed0cc8c6432d tempest-TestShelveInstance-1062230741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-5762d68a-c155-432d-95d9-7039da00472f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1abe07f2-fc6a-46bb-86e9-67ca4c9d075d', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:32:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-a5e256e9-037e-4e46-9a2d-a16249f9f7c6 req-f9f773f3-b0ee-414c-b875-ed0cc8c6432d tempest-TestShelveInstance-1062230741 None] attachment_update completed successfully. Nov 06 21:32:45 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:45 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-da033f3a-b29d-4492-8129-0a260a4e5968 req-107721c5-2663-443d-bb78-4bdbd1a255fa tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-da033f3a-b29d-4492-8129-0a260a4e5968 req-107721c5-2663-443d-bb78-4bdbd1a255fa tempest-TestStampPattern-1408597911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-da033f3a-b29d-4492-8129-0a260a4e5968 req-107721c5-2663-443d-bb78-4bdbd1a255fa tempest-TestStampPattern-1408597911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-da033f3a-b29d-4492-8129-0a260a4e5968 req-107721c5-2663-443d-bb78-4bdbd1a255fa tempest-TestStampPattern-1408597911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b425781-7d24-4fd9-bf67-16a6403437e3', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:32:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-da033f3a-b29d-4492-8129-0a260a4e5968 req-107721c5-2663-443d-bb78-4bdbd1a255fa tempest-TestStampPattern-1408597911 None] attachment_update completed successfully. Nov 06 21:32:52 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-e146429c-8384-4985-8e9e-778328e7c23d req-3fda4c60-343c-40fb-ad3b-0817fec74689 tempest-TestStampPattern-1408597911 None] Terminate volume connection completed successfully. Nov 06 21:32:52 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-e146429c-8384-4985-8e9e-778328e7c23d req-3fda4c60-343c-40fb-ad3b-0817fec74689 tempest-TestStampPattern-1408597911 None] Deleting attachment 3b425781-7d24-4fd9-bf67-16a6403437e3. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:32:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Creating offline snapshot 1e0deec3-11b3-417b-a501-30979d46b818 of volume 9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:32:53 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d3d11-2500-4eca-aeac-1273e62a74bd]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:32:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:53 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 Nov 06 21:32:53 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:54 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3" returned: 0 in 0.386s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:54 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 1G Nov 06 21:32:54 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:54 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 1G" returned: 0 in 0.416s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:54 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 Nov 06 21:32:54 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:54 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818" returned: 0 in 0.288s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:54 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 is being set with open permissions: ugo+rw Nov 06 21:32:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:54 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 Nov 06 21:32:54 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:55 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818" returned: 0 in 0.249s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:55 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.info Nov 06 21:32:55 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:55 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.info" returned: 0 in 0.240s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:55 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.info is being set with open permissions: ugo+rw Nov 06 21:32:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:55 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.info Nov 06 21:32:55 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:55 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.info" returned: 0 in 0.235s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:55 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-804ed8be-ae44-45b7-977f-ab9c70176989 tempest-TestStampPattern-1408597911 None] Create snapshot completed successfully Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Flow 'volume_create_manager' (f783322d-c50a-44fa-8ced-a428e75a112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2563871-060f-45ae-8424-4d42600406a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2563871-060f-45ae-8424-4d42600406a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-685049298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bf3c35-a968-4471-9299-04f4250dba66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d385f3b67df84baf851fb6d22f73da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e0deec3-11b3-417b-a501-30979d46b818,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:02Z,use_quota=True,user_id='ad99b680936c4c66840c71b340521335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df468e20-c0cb-451a-8f4f-f238b250bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df468e20-c0cb-451a-8f4f-f238b250bb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee2e6ba-c5b7-4de3-a9a8-0a8489fac085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee2e6ba-c5b7-4de3-a9a8-0a8489fac085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09bf3c35-a968-4471-9299-04f4250dba66', 'volume_name': 'volume-09bf3c35-a968-4471-9299-04f4250dba66', 'volume_size': 1, 'snapshot_id': '1e0deec3-11b3-417b-a501-30979d46b818'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8d938-ba12-4eab-a7f9-22a136dfb09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8d938-ba12-4eab-a7f9-22a136dfb09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0ac096-d869-42d1-af4c-123896923e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:02 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Volume 09bf3c35-a968-4471-9299-04f4250dba66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09bf3c35-a968-4471-9299-04f4250dba66', 'volume_size': 1, 'snapshot_id': '1e0deec3-11b3-417b-a501-30979d46b818'} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-quobyte-1e0deec3-11b3-417b-a501-30979d46b818-09bf3c35-a968-4471-9299-04f4250dba66" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-1e0deec3-11b3-417b-a501-30979d46b818-09bf3c35-a968-4471-9299-04f4250dba66" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Creating volume 09bf3c35-a968-4471-9299-04f4250dba66 from snapshot 1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-quobyte-09bf3c35-a968-4471-9299-04f4250dba66" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-09bf3c35-a968-4471-9299-04f4250dba66" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] snapshot: 1e0deec3-11b3-417b-a501-30979d46b818, volume: 09bf3c35-a968-4471-9299-04f4250dba66, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d692737-c343-4a98-9c98-167716b6e589]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:02 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 Nov 06 21:33:02 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:03 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818" returned: 0 in 0.412s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[678764da-15bb-44fd-a2c5-ce966dbb854e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:03 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 Nov 06 21:33:03 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:03 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3" returned: 0 in 0.477s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:33:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:03 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 Nov 06 21:33:03 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-5653b491-281c-4861-90e0-0a26672fbbf2 tempest-TestShelveInstance-1062230741 None] Terminate volume connection completed successfully. Nov 06 21:33:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-5653b491-281c-4861-90e0-0a26672fbbf2 tempest-TestShelveInstance-1062230741 None] Deleting attachment 1abe07f2-fc6a-46bb-86e9-67ca4c9d075d. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:33:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Acquiring lock "cinder-5762d68a-c155-432d-95d9-7039da00472f-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:33:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Lock "cinder-5762d68a-c155-432d-95d9-7039da00472f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:33:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Acquiring lock "cinder-quobyte-5762d68a-c155-432d-95d9-7039da00472f" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:33:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Lock "cinder-quobyte-5762d68a-c155-432d-95d9-7039da00472f" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:33:09 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9643a886-961b-47c2-b727-4641f0206c06]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:09 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f Nov 06 21:33:09 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:10 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f" returned: 0 in 0.876s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:10 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f Nov 06 21:33:10 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:10 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5762d68a-c155-432d-95d9-7039da00472f" returned: 0 in 0.495s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Lock "cinder-quobyte-5762d68a-c155-432d-95d9-7039da00472f" released by "delete_volume" :: held 1.472s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.quota [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Created reservations ['0a8444f3-60cf-41f2-aba5-29c192c42fee', 'e0563f4a-54c8-401e-8dee-df7b738aa06d', '87a091ec-6c6c-4939-afc0-c10b880100cc', '2d3db1e6-1048-4eda-8e39-42602cabc439'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:11 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:33:11 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:11 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:33:11 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:11 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.784s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:33:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:33:12 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.714s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:12 devstack cinder-volume[87450]: DEBUG cinder.manager [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:33:12 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Deleted volume successfully. Nov 06 21:33:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [req-8ef917a7-85da-4636-a30b-c0d0a30156b1 req-eb733ce7-8ace-492d-82b8-a415fa446e32 tempest-TestShelveInstance-1062230741 None] Lock "cinder-5762d68a-c155-432d-95d9-7039da00472f-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:33:13 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66" returned: 0 in 9.821s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:13 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3, size 1024.00 MB, duration 9.82 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:33:13 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Converted 1024.00 MB image at 104.26 MB/s Nov 06 21:33:13 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 is being set with open permissions: ugo+rw Nov 06 21:33:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:13 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 Nov 06 21:33:13 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:13 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66" returned: 0 in 0.426s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-09bf3c35-a968-4471-9299-04f4250dba66" released by "_copy_volume_from_snapshot" :: held 11.250s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:33:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-1e0deec3-11b3-417b-a501-30979d46b818-09bf3c35-a968-4471-9299-04f4250dba66" released by "_create_volume_from_snapshot" :: held 11.356s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:33:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.371s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0ac096-d869-42d1-af4c-123896923e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bf3c35-a968-4471-9299-04f4250dba66', 'volume_size': 1, 'snapshot_id': '1e0deec3-11b3-417b-a501-30979d46b818'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867d502e-f9ac-43cb-947f-73b7d4de84f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:14 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Volume volume-09bf3c35-a968-4471-9299-04f4250dba66 (09bf3c35-a968-4471-9299-04f4250dba66): created successfully Nov 06 21:33:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867d502e-f9ac-43cb-947f-73b7d4de84f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Flow 'volume_create_manager' (f783322d-c50a-44fa-8ced-a428e75a112c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:14 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-997e710b-22d9-461a-9e67-0e5a09ec9100 tempest-TestStampPattern-1408597911 None] Created volume successfully. Nov 06 21:33:24 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=26,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:24 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Flow 'volume_create_manager' (c7af27ef-e60e-48b9-8b91-4a29b1c569a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b91adf6-749e-4b18-9dd2-ee7fb1371e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b91adf6-749e-4b18-9dd2-ee7fb1371e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1313763238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5af5380-867d-43d9-9242-6fbf92951c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e853f32322e49e6b6b573417303994f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:48Z,use_quota=True,user_id='5e6e89c8a01548b39a29d302a9109b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c99b28a-c977-4b3a-8238-1e7bea4b0092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c99b28a-c977-4b3a-8238-1e7bea4b0092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb790f7-20f7-43b6-8889-4f0bb5b3890a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb790f7-20f7-43b6-8889-4f0bb5b3890a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5af5380-867d-43d9-9242-6fbf92951c75', 'volume_name': 'volume-a5af5380-867d-43d9-9242-6fbf92951c75', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b709cdc-8d5c-45e1-bf69-a4a2e90aa242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b709cdc-8d5c-45e1-bf69-a4a2e90aa242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14287a2e-d2c6-46c7-9d59-f0fae7d27505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:47 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Volume a5af5380-867d-43d9-9242-6fbf92951c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5af5380-867d-43d9-9242-6fbf92951c75', 'volume_size': 1} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1313763238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5af5380-867d-43d9-9242-6fbf92951c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e853f32322e49e6b6b573417303994f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:48Z,use_quota=True,user_id='5e6e89c8a01548b39a29d302a9109b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Creating volume a5af5380-867d-43d9-9242-6fbf92951c75 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:33:47 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:33:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:47 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 1073741824 Nov 06 21:33:47 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:48 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 1073741824" returned: 0 in 0.408s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:48 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 Nov 06 21:33:48 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:48 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75" returned: 0 in 0.249s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14287a2e-d2c6-46c7-9d59-f0fae7d27505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5af5380-867d-43d9-9242-6fbf92951c75', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fe7d61-3fd9-4937-b8ca-44ad2d0a4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:48 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Volume volume-a5af5380-867d-43d9-9242-6fbf92951c75 (a5af5380-867d-43d9-9242-6fbf92951c75): created successfully Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fe7d61-3fd9-4937-b8ca-44ad2d0a4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:48 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Flow 'volume_create_manager' (c7af27ef-e60e-48b9-8b91-4a29b1c569a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f9d973db-a02d-423e-a2e5-f93d0ca5fa92 tempest-TestImageHashVerification-1575906581 None] Created volume successfully. Nov 06 21:33:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ca985-8455-4478-a601-fc653274500c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:49 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 Nov 06 21:33:49 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:49 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75" returned: 0 in 0.365s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:49 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bda2490-789e-4306-a64c-7570e5ed9aab]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:50 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 Nov 06 21:33:50 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:50 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75" returned: 0 in 0.359s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 /opt/stack/data/cinder/conversion/a5af5380-867d-43d9-9242-6fbf92951c75.temp_image.d8f73acf-bc5f-4eef-9a99-aac5388753fb4es6hvls.img {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:50 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 /opt/stack/data/cinder/conversion/a5af5380-867d-43d9-9242-6fbf92951c75.temp_image.d8f73acf-bc5f-4eef-9a99-aac5388753fb4es6hvls.img Nov 06 21:33:50 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-0c0731ba-cc48-4d29-a14e-e2f0d9fe129b req-88e932b9-aa55-4471-a15b-c7add50a7081 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:56 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 /opt/stack/data/cinder/conversion/a5af5380-867d-43d9-9242-6fbf92951c75.temp_image.d8f73acf-bc5f-4eef-9a99-aac5388753fb4es6hvls.img" returned: 0 in 5.802s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:56 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ca201-2e34-43a5-9e0a-e4fb01f4f37e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:56 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 Nov 06 21:33:56 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:56 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75" returned: 0 in 0.503s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:56 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/conversion/a5af5380-867d-43d9-9242-6fbf92951c75.temp_image.d8f73acf-bc5f-4eef-9a99-aac5388753fb4es6hvls.img {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:33:56 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Converted 1024.00 MB image at 176.45 MB/s Nov 06 21:33:56 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] d8f73acf-bc5f-4eef-9a99-aac5388753fb was raw, no need to convert to raw {{(pid=87450) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:34:06 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:06 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:11 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:34:11 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:11 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.314s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:34:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:34:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.048s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Uploaded volume to glance image-id: d8f73acf-bc5f-4eef-9a99-aac5388753fb. {{(pid=87450) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 21:34:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-0c0731ba-cc48-4d29-a14e-e2f0d9fe129b req-88e932b9-aa55-4471-a15b-c7add50a7081 tempest-TestStampPattern-1408597911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.508s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:15 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c5d2a2be-9109-4961-877d-1c83179cbe89 tempest-TestImageHashVerification-1575906581 None] Copy volume to image completed successfully. Nov 06 21:34:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [req-0c0731ba-cc48-4d29-a14e-e2f0d9fe129b req-88e932b9-aa55-4471-a15b-c7add50a7081 tempest-TestStampPattern-1408597911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-0c0731ba-cc48-4d29-a14e-e2f0d9fe129b req-88e932b9-aa55-4471-a15b-c7add50a7081 tempest-TestStampPattern-1408597911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a', 'name': 'volume-09bf3c35-a968-4471-9299-04f4250dba66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a222599-9e7d-408f-abe2-dfe7d1a39784', 'enforce_multipath': True} {{(pid=87450) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:34:15 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-0c0731ba-cc48-4d29-a14e-e2f0d9fe129b req-88e932b9-aa55-4471-a15b-c7add50a7081 tempest-TestStampPattern-1408597911 None] attachment_update completed successfully. Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Acquiring lock "cinder-a5af5380-867d-43d9-9242-6fbf92951c75-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Lock "cinder-a5af5380-867d-43d9-9242-6fbf92951c75-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Acquiring lock "cinder-quobyte-a5af5380-867d-43d9-9242-6fbf92951c75" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Lock "cinder-quobyte-a5af5380-867d-43d9-9242-6fbf92951c75" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12681b03-728f-4a17-a775-c6be94563dea]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:17 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 Nov 06 21:34:17 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:17 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75" returned: 0 in 0.388s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:17 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75 Nov 06 21:34:17 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:17 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a5af5380-867d-43d9-9242-6fbf92951c75" returned: 0 in 0.253s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Lock "cinder-quobyte-a5af5380-867d-43d9-9242-6fbf92951c75" released by "delete_volume" :: held 0.687s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Created reservations ['479f5574-3bbf-48b8-8c23-b360f70bf735', '95ecd518-006e-4189-96b8-8df26df3dbca', '91cc7164-6b9c-4264-b378-09c4c0e76788', '7bd7dbb3-9800-4e44-87c3-620946a2e390'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:17 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:34:17 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:18 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.280s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:18 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Deleted volume successfully. Nov 06 21:34:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1ea4bbd4-eec6-4c70-8a25-e5a6d411caa1 tempest-TestImageHashVerification-1575906581 None] Lock "cinder-a5af5380-867d-43d9-9242-6fbf92951c75-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [req-cfcb13b9-869e-4967-bac5-00c48695ec93 req-71bdd1e2-9af9-49c7-8202-858ea2e5d6a6 tempest-TestStampPattern-1408597911 None] Terminate volume connection completed successfully. Nov 06 21:34:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [req-cfcb13b9-869e-4967-bac5-00c48695ec93 req-71bdd1e2-9af9-49c7-8202-858ea2e5d6a6 tempest-TestStampPattern-1408597911 None] Deleting attachment 4a222599-9e7d-408f-abe2-dfe7d1a39784. {{(pid=87450) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-09bf3c35-a968-4471-9299-04f4250dba66-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Lock "cinder-09bf3c35-a968-4471-9299-04f4250dba66-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-quobyte-09bf3c35-a968-4471-9299-04f4250dba66" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-09bf3c35-a968-4471-9299-04f4250dba66" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9bc4b9-8529-45c1-ae53-e77464519bf1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:23 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 Nov 06 21:34:23 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:23 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:23 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66 Nov 06 21:34:23 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:24 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-09bf3c35-a968-4471-9299-04f4250dba66" returned: 0 in 0.255s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-09bf3c35-a968-4471-9299-04f4250dba66" released by "delete_volume" :: held 0.735s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Created reservations ['5c0e0e69-b881-4fda-abbf-74a37c1f8bee', '9721c9ee-f0ea-42e3-8a88-a3724b69c2a0', 'c6f99a7b-6f34-4ea0-8831-f9a1ac255776', 'b3588c17-bd12-408a-a48b-66d57a65c7ea'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:24 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:34:24 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:24 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.294s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Deleted volume successfully. Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-517aa4ae-a451-48ae-ab4f-0828478c471d tempest-TestStampPattern-1408597911 None] Lock "cinder-09bf3c35-a968-4471-9299-04f4250dba66-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-1e0deec3-11b3-417b-a501-30979d46b818-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Lock "cinder-1e0deec3-11b3-417b-a501-30979d46b818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-quobyte-9d0317f4-bd05-4785-b5a1-10d77275dbd3" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-9d0317f4-bd05-4785-b5a1-10d77275dbd3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-quobyte-1e0deec3-11b3-417b-a501-30979d46b818" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-1e0deec3-11b3-417b-a501-30979d46b818" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Deleting offline snapshot 1e0deec3-11b3-417b-a501-30979d46b818 of volume 9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] snapshot_file for this snap is: volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bab758-cfe0-44cf-a426-28497e617006]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:25 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 Nov 06 21:34:25 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:25 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818" returned: 0 in 0.399s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:34:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0332ea23-a92a-4a1a-ba1c-a80514ea36d3]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:25 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 Nov 06 21:34:25 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:25 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3" returned: 0 in 0.488s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:25 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 Nov 06 21:34:25 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:26 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818" returned: 0 in 0.337s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:26 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818 Nov 06 21:34:26 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:26 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3.1e0deec3-11b3-417b-a501-30979d46b818" returned: 0 in 0.288s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-1e0deec3-11b3-417b-a501-30979d46b818" released by "_delete_snapshot" :: held 1.635s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-9d0317f4-bd05-4785-b5a1-10d77275dbd3" released by "delete_snapshot" :: held 1.664s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:26 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Created reservations ['4fefd72d-b62c-40ea-8640-7cb08b7d3db3', '748a8fa9-00af-40d7-a592-15819249f160', '2638431e-e35f-4c91-a17b-361d5e71adab', 'e2e7652a-a63b-48ef-9b99-1ddc28319ee6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Delete snapshot completed successfully. Nov 06 21:34:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a261467-b9f6-40df-b0d8-8f41ba09d977 tempest-TestStampPattern-1408597911 None] Lock "cinder-1e0deec3-11b3-417b-a501-30979d46b818-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-9d0317f4-bd05-4785-b5a1-10d77275dbd3-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Lock "cinder-9d0317f4-bd05-4785-b5a1-10d77275dbd3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Acquiring lock "cinder-quobyte-9d0317f4-bd05-4785-b5a1-10d77275dbd3" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-9d0317f4-bd05-4785-b5a1-10d77275dbd3" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5792649-e5b7-4afc-96b7-a0610cfc58e8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:30 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 Nov 06 21:34:30 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:31 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3" returned: 0 in 0.346s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:31 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3 Nov 06 21:34:31 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:31 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9d0317f4-bd05-4785-b5a1-10d77275dbd3" returned: 0 in 0.256s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Lock "cinder-quobyte-9d0317f4-bd05-4785-b5a1-10d77275dbd3" released by "delete_volume" :: held 0.662s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Created reservations ['0fdc4070-e8c6-4ce3-b7f6-ce4249cc68dc', 'd18c0dcb-0acd-4553-b136-fd9cb14767a7', '4131338d-c9f0-464c-8d10-396b43648d12', '0e6db97e-b5b6-46fd-943e-0aa6402f12b4'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:31 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:34:31 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:31 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.237s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Deleted volume successfully. Nov 06 21:34:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a221769a-cde7-4b76-96b7-93ea0d8e35d3 tempest-TestStampPattern-1408597911 None] Lock "cinder-9d0317f4-bd05-4785-b5a1-10d77275dbd3-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:41 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:41 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=30,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Flow 'volume_create_manager' (18b6dd7b-aead-43a0-ae4f-b3646646cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6500c5-e5e6-4fab-9005-1f2d7218ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6500c5-e5e6-4fab-9005-1f2d7218ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce425586-ee1a-4476-93da-f9819d0e414a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6e6836eab0441394e4cd147c4c9f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:43Z,use_quota=True,user_id='291a4d5a41ff41daa3dea837ed6b1f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19580b8d-8eba-4a1b-9129-2a71db96f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19580b8d-8eba-4a1b-9129-2a71db96f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1243b5-0879-47b7-a3f4-c82e1856c082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1243b5-0879-47b7-a3f4-c82e1856c082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce425586-ee1a-4476-93da-f9819d0e414a', 'volume_name': 'volume-ce425586-ee1a-4476-93da-f9819d0e414a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f79d65-f4ea-45a2-adc3-df81b2217f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f79d65-f4ea-45a2-adc3-df81b2217f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729224d0-3b2e-43bb-854e-95209d26d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:43 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Volume ce425586-ee1a-4476-93da-f9819d0e414a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce425586-ee1a-4476-93da-f9819d0e414a', 'volume_size': 1} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce425586-ee1a-4476-93da-f9819d0e414a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6e6836eab0441394e4cd147c4c9f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:43Z,use_quota=True,user_id='291a4d5a41ff41daa3dea837ed6b1f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Creating volume ce425586-ee1a-4476-93da-f9819d0e414a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:43 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:34:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:43 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a 1073741824 Nov 06 21:34:43 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:44 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a 1073741824" returned: 0 in 0.436s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:44 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a Nov 06 21:34:44 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:44 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a" returned: 0 in 0.272s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729224d0-3b2e-43bb-854e-95209d26d903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce425586-ee1a-4476-93da-f9819d0e414a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906ef0f5-5bd4-41e0-bcb5-7a262079de20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:44 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Volume volume-ce425586-ee1a-4476-93da-f9819d0e414a (ce425586-ee1a-4476-93da-f9819d0e414a): created successfully Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906ef0f5-5bd4-41e0-bcb5-7a262079de20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Flow 'volume_create_manager' (18b6dd7b-aead-43a0-ae4f-b3646646cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-40f618bc-fe52-4864-9a7b-1aae0188b8a8 tempest-CinderUnicodeTest-319146641 None] Created volume successfully. Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Flow 'volume_create_manager' (3061d756-034d-4029-b65b-f75241941c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fdeda5-edaa-4120-bca4-d6110e9e1ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fdeda5-edaa-4120-bca4-d6110e9e1ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1574126319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2544c7-a7c0-46ef-b9af-69894ad12a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6e6836eab0441394e4cd147c4c9f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:45Z,use_quota=True,user_id='291a4d5a41ff41daa3dea837ed6b1f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a645bb2c-6665-4c42-a64e-443bc5bb81ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a645bb2c-6665-4c42-a64e-443bc5bb81ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df024b8-be45-4577-85db-3395d15c9864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df024b8-be45-4577-85db-3395d15c9864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee2544c7-a7c0-46ef-b9af-69894ad12a9c', 'volume_name': 'volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a132812-465f-445a-900b-275178ed0458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a132812-465f-445a-900b-275178ed0458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9504d736-0a77-4b94-868d-1f5a2f533ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Volume ee2544c7-a7c0-46ef-b9af-69894ad12a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c', 'volume_size': 1} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1574126319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2544c7-a7c0-46ef-b9af-69894ad12a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6e6836eab0441394e4cd147c4c9f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:45Z,use_quota=True,user_id='291a4d5a41ff41daa3dea837ed6b1f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Creating volume ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:45 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:45 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c 1073741824 Nov 06 21:34:45 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:45 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c 1073741824" returned: 0 in 0.439s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:45 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c Nov 06 21:34:45 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:45 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9504d736-0a77-4b94-868d-1f5a2f533ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9135b8b3-3db4-4761-b575-c5fe25a5adf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Volume volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c (ee2544c7-a7c0-46ef-b9af-69894ad12a9c): created successfully Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9135b8b3-3db4-4761-b575-c5fe25a5adf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Flow 'volume_create_manager' (3061d756-034d-4029-b65b-f75241941c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b07b1ed7-1f9f-45b2-bfec-9fcb2ce489b0 tempest-CinderUnicodeTest-319146641 None] Created volume successfully. Nov 06 21:34:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Creating offline snapshot 2291e2bc-9923-413d-9f17-c1f5d4ba2d09 of volume ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:34:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[830cfe71-10ed-467f-94b0-fcfce812a073]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:46 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c Nov 06 21:34:46 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:46 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" returned: 0 in 0.393s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:46 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 1G Nov 06 21:34:46 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:47 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 1G" returned: 0 in 0.399s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:47 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 Nov 06 21:34:47 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:47 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09" returned: 0 in 0.294s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:47 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 is being set with open permissions: ugo+rw Nov 06 21:34:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:47 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 Nov 06 21:34:47 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:47 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09" returned: 0 in 0.250s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:47 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.info Nov 06 21:34:47 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:47 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.info" returned: 0 in 0.267s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:48 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.info is being set with open permissions: ugo+rw Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:48 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.info Nov 06 21:34:48 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:48 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.info" returned: 0 in 0.263s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e2884030-5188-4ea1-909b-24d5f1291fbd tempest-CinderUnicodeTest-319146641 None] Create snapshot completed successfully Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "cinder-2291e2bc-9923-413d-9f17-c1f5d4ba2d09-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-2291e2bc-9923-413d-9f17-c1f5d4ba2d09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "cinder-quobyte-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "cinder-quobyte-2291e2bc-9923-413d-9f17-c1f5d4ba2d09" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-2291e2bc-9923-413d-9f17-c1f5d4ba2d09" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Deleting offline snapshot 2291e2bc-9923-413d-9f17-c1f5d4ba2d09 of volume ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] snapshot_file for this snap is: volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbe24d5-61ed-460a-9ff5-e39c1dad079a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:48 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 Nov 06 21:34:48 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:48 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09" returned: 0 in 0.366s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1b06ae-946c-4513-9fbb-1ebaa261c76f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:49 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c Nov 06 21:34:49 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:49 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" returned: 0 in 0.363s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:49 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 Nov 06 21:34:49 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:49 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09" returned: 0 in 0.330s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:49 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09 Nov 06 21:34:49 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:49 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c.2291e2bc-9923-413d-9f17-c1f5d4ba2d09" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-2291e2bc-9923-413d-9f17-c1f5d4ba2d09" released by "_delete_snapshot" :: held 1.414s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" released by "delete_snapshot" :: held 1.454s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Created reservations ['dff6ba2b-3fea-4a7b-be89-dd58fb350215', '524ab6bb-268b-4633-80ee-4cba9a02a69b', '2125bb44-a704-4fb3-a8ca-7bf7458fd676', 'f956850f-7cbc-4eb2-b780-7828f106f7ff'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Delete snapshot completed successfully. Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4815ce17-1d8d-45b9-b85d-d3d8a82ae888 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-2291e2bc-9923-413d-9f17-c1f5d4ba2d09-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Acquiring lock "cinder-ee2544c7-a7c0-46ef-b9af-69894ad12a9c-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Lock "cinder-ee2544c7-a7c0-46ef-b9af-69894ad12a9c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Acquiring lock "cinder-quobyte-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6a2e58-c267-402f-acd1-288bf1efe216]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:50 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c Nov 06 21:34:50 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:51 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" returned: 0 in 0.361s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:51 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c Nov 06 21:34:51 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:51 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" returned: 0 in 0.249s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-ee2544c7-a7c0-46ef-b9af-69894ad12a9c" released by "delete_volume" :: held 0.674s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Created reservations ['e8c9c827-ac73-4472-821f-aef871c6efeb', '07fcb4b3-a883-485a-8f96-cb4498e8a4b5', '3e9c3d3a-2573-4573-9114-d668b00f5662', '4e878de3-488e-4c2f-bff2-e82edb2579f0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:51 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:34:51 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:51 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Deleted volume successfully. Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-feb07837-f72b-4b18-a251-b61fd5b9402e tempest-CinderUnicodeTest-319146641 None] Lock "cinder-ee2544c7-a7c0-46ef-b9af-69894ad12a9c-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "cinder-ce425586-ee1a-4476-93da-f9819d0e414a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-ce425586-ee1a-4476-93da-f9819d0e414a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "cinder-quobyte-ce425586-ee1a-4476-93da-f9819d0e414a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-ce425586-ee1a-4476-93da-f9819d0e414a" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a881e2-268c-453b-aeca-8820678457fd]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:52 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a Nov 06 21:34:52 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:52 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a" returned: 0 in 0.367s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:52 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a Nov 06 21:34:52 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:52 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ce425586-ee1a-4476-93da-f9819d0e414a" returned: 0 in 0.260s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-quobyte-ce425586-ee1a-4476-93da-f9819d0e414a" released by "delete_volume" :: held 0.670s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Created reservations ['d073b12e-b7bc-4f53-a8cb-d472c8bcd02c', '33daad75-ba1a-418c-8198-b4b5c279d8b8', '57a8f705-01fb-4ada-aea9-26dd8cc77177', 'f3a2ddd8-f735-41ae-b1cd-7e02817077e9'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:52 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:34:52 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:53 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Deleted volume successfully. Nov 06 21:34:52 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-495cf4f3-e2d6-4fd8-abf6-855bcf8e0879 tempest-CinderUnicodeTest-319146641 None] Lock "cinder-ce425586-ee1a-4476-93da-f9819d0e414a-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:02 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=29,cinder:DELETE=3,cinder:SELECT=21,cinder:INSERT=8 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:02 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:11 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:35:11 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:11 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.421s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:35:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Flow 'volume_create_manager' (5b3963c8-a0de-4896-a4c8-e5d3329dcab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b412c0-3745-4738-a978-5d874695853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b412c0-3745-4738-a978-5d874695853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2071468884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc399b6ed314458bb4b8530c49fdab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:18Z,use_quota=True,user_id='7dfecf5d38d84ef299cd7ca6cb59f5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71a8ad3-5f2f-41c9-aba4-c6aa25d97c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71a8ad3-5f2f-41c9-aba4-c6aa25d97c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c8be29-a6ae-4e24-abe0-8b97ae20dfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c8be29-a6ae-4e24-abe0-8b97ae20dfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a', 'volume_name': 'volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cf69d0-1390-4b42-8d03-b51525fb7e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cf69d0-1390-4b42-8d03-b51525fb7e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f9f33-29d7-4df7-8a37-64d05ca8f9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Volume 548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a', 'volume_size': 1} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2071468884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc399b6ed314458bb4b8530c49fdab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:18Z,use_quota=True,user_id='7dfecf5d38d84ef299cd7ca6cb59f5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Creating volume 548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:18 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:18 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a 1073741824 Nov 06 21:35:18 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:18 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a 1073741824" returned: 0 in 0.425s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:18 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a Nov 06 21:35:18 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:18 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" returned: 0 in 0.247s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f9f33-29d7-4df7-8a37-64d05ca8f9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9ce307-57a3-46a6-846d-f98800427296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Volume volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a (548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a): created successfully Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9ce307-57a3-46a6-846d-f98800427296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Flow 'volume_create_manager' (5b3963c8-a0de-4896-a4c8-e5d3329dcab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1857e846-e565-4757-8345-c9cde4f5fb03 tempest-SnapshotDependencyTests-1205032725 None] Created volume successfully. Nov 06 21:35:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Creating offline snapshot 23e5ff4c-e78b-4945-ae50-d0e789defc9a of volume 548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:35:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad01aa1-f2af-46f5-89ed-67d63d177d16]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:19 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a Nov 06 21:35:19 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:19 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" returned: 0 in 0.353s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:19 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a 1G Nov 06 21:35:19 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:20 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a 1G" returned: 0 in 0.400s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:20 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a Nov 06 21:35:20 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:20 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:20 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a is being set with open permissions: ugo+rw Nov 06 21:35:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:20 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a Nov 06 21:35:20 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:20 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a" returned: 0 in 0.268s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:20 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.info Nov 06 21:35:20 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:21 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.info" returned: 0 in 0.279s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:21 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.info is being set with open permissions: ugo+rw Nov 06 21:35:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:21 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.info Nov 06 21:35:21 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:21 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.info" returned: 0 in 0.268s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ec2a600e-408b-4b33-b436-30fa359f5c6e tempest-SnapshotDependencyTests-1205032725 None] Create snapshot completed successfully Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Flow 'volume_create_manager' (ddef5512-eea0-40fe-9112-ea4fe45a40ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665ea4b8-40f0-41cc-9953-8c23d438cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665ea4b8-40f0-41cc-9953-8c23d438cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e3e70a-5be6-495e-a5b5-24a5bb34f29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc399b6ed314458bb4b8530c49fdab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=23e5ff4c-e78b-4945-ae50-d0e789defc9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:22Z,use_quota=True,user_id='7dfecf5d38d84ef299cd7ca6cb59f5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a940125-0382-4343-97b2-06c722153eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a940125-0382-4343-97b2-06c722153eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee9f9c6-f954-4969-8c88-3268db8e77ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee9f9c6-f954-4969-8c88-3268db8e77ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51e3e70a-5be6-495e-a5b5-24a5bb34f29b', 'volume_name': 'volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b', 'volume_size': 1, 'snapshot_id': '23e5ff4c-e78b-4945-ae50-d0e789defc9a'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abae9886-a86a-400d-ae4b-b6906e6368de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abae9886-a86a-400d-ae4b-b6906e6368de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625ea038-80c7-40b4-a42a-5d0d48a369bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Volume 51e3e70a-5be6-495e-a5b5-24a5bb34f29b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b', 'volume_size': 1, 'snapshot_id': '23e5ff4c-e78b-4945-ae50-d0e789defc9a'} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-quobyte-23e5ff4c-e78b-4945-ae50-d0e789defc9a-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-23e5ff4c-e78b-4945-ae50-d0e789defc9a-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Creating volume 51e3e70a-5be6-495e-a5b5-24a5bb34f29b from snapshot 23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-quobyte-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] snapshot: 23e5ff4c-e78b-4945-ae50-d0e789defc9a, volume: 51e3e70a-5be6-495e-a5b5-24a5bb34f29b, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af38207-605a-42ab-a916-81fb19d721ea]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:22 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a Nov 06 21:35:22 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:22 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a" returned: 0 in 0.370s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f120dbe-c4ab-42e4-86cf-58250dcbb46f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:22 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a Nov 06 21:35:22 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:23 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" returned: 0 in 0.361s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:35:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:35:23 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:35:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:23 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b Nov 06 21:35:23 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" returned: 0 in 5.704s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:28 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:35:28 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Converted 1024.00 MB image at 179.50 MB/s Nov 06 21:35:28 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b is being set with open permissions: ugo+rw Nov 06 21:35:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:28 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b Nov 06 21:35:28 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" returned: 0 in 0.247s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" released by "_copy_volume_from_snapshot" :: held 6.805s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-23e5ff4c-e78b-4945-ae50-d0e789defc9a-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" released by "_create_volume_from_snapshot" :: held 6.865s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.882s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625ea038-80c7-40b4-a42a-5d0d48a369bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b', 'volume_size': 1, 'snapshot_id': '23e5ff4c-e78b-4945-ae50-d0e789defc9a'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87324e94-0305-4a02-8f9e-dd1b6922d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Volume volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b (51e3e70a-5be6-495e-a5b5-24a5bb34f29b): created successfully Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87324e94-0305-4a02-8f9e-dd1b6922d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Flow 'volume_create_manager' (ddef5512-eea0-40fe-9112-ea4fe45a40ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c9dc6309-838c-4eff-a89b-8ec2b6fabbeb tempest-SnapshotDependencyTests-1205032725 None] Created volume successfully. Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-23e5ff4c-e78b-4945-ae50-d0e789defc9a-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-23e5ff4c-e78b-4945-ae50-d0e789defc9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-quobyte-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-quobyte-23e5ff4c-e78b-4945-ae50-d0e789defc9a" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-23e5ff4c-e78b-4945-ae50-d0e789defc9a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Deleting offline snapshot 23e5ff4c-e78b-4945-ae50-d0e789defc9a of volume 548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] snapshot_file for this snap is: volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee12cd-41ac-4d34-95b6-7e5e0a9e0b37]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:29 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a Nov 06 21:35:29 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:30 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a" returned: 0 in 0.368s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ac013-1a0e-4857-998c-cb25b586ee9c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:30 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a Nov 06 21:35:30 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:30 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" returned: 0 in 0.526s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:30 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a Nov 06 21:35:30 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a" returned: 0 in 0.327s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a Nov 06 21:35:31 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a.23e5ff4c-e78b-4945-ae50-d0e789defc9a" returned: 0 in 0.248s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-23e5ff4c-e78b-4945-ae50-d0e789defc9a" released by "_delete_snapshot" :: held 1.571s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" released by "delete_snapshot" :: held 1.592s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Created reservations ['09b4cc01-c900-4fc6-a360-212726f26ea0', '2e181f2e-bfe9-4e62-8d19-b6fc11c8e2f1', 'fa95e5e6-ddba-44e0-805f-e5b2193e8f01', 'bee4d211-ff66-471d-adc6-27ca85672af7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Delete snapshot completed successfully. Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-23e5afca-3e19-47af-a1f1-bb66d71706bc tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-23e5ff4c-e78b-4945-ae50-d0e789defc9a-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-quobyte-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61d1d55-bf8b-40c7-8c3e-3ad12b183a97]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a Nov 06 21:35:32 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" returned: 0 in 0.391s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a Nov 06 21:35:32 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" returned: 0 in 0.248s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a" released by "delete_volume" :: held 0.704s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Created reservations ['14e0c6c3-8718-40ee-b8e3-395ef946f1e8', '49d28758-6be5-4391-b19d-0c4668ef5ef2', '240ace1b-68c2-427e-a777-6572ad2bdc19', '681c3fc8-4b55-4c62-b16d-93f65a30c1d2'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:35:32 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.241s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Deleted volume successfully. Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9f2e8a1a-fb51-4252-bf12-670e108c93d3 tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-548fd7f0-bc5f-4c1e-8fe3-0bcef724d69a-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-51e3e70a-5be6-495e-a5b5-24a5bb34f29b-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-51e3e70a-5be6-495e-a5b5-24a5bb34f29b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "cinder-quobyte-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" acquired by "delete_volume" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee786292-83c1-4c30-8882-4f677457dd65]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b Nov 06 21:35:33 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b Nov 06 21:35:33 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" returned: 0 in 0.260s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-quobyte-51e3e70a-5be6-495e-a5b5-24a5bb34f29b" released by "delete_volume" :: held 0.658s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Created reservations ['c9f34edd-beac-45c7-8d62-c30e831e6fb8', '4458d040-1c97-46de-b95f-56b82386dada', '1ee7af97-94d0-4b19-939b-741e9c3ccd9c', '9f904951-9684-46ea-9d35-a761e697b6b9'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:35:33 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.235s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:34 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Deleted volume successfully. Nov 06 21:35:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2b4ea2d7-bd65-4028-877d-c69b39a396de tempest-SnapshotDependencyTests-1205032725 None] Lock "cinder-51e3e70a-5be6-495e-a5b5-24a5bb34f29b-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:43 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2,cinder:SELECT=25 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:44 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Flow 'volume_create_manager' (3ad05c47-a436-492a-b5c0-aa139195e553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25d5967-7292-4a95-9cee-77a1161a9130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25d5967-7292-4a95-9cee-77a1161a9130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1627541607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f17327-ed03-4a33-b2d2-573e40ac58cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5181038a424f9ea6667e5a0a8d65c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:55Z,use_quota=True,user_id='fb333cddee1947d2adeb0b27e916180f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f3a903-02e3-498a-bbec-b80c441a885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f3a903-02e3-498a-bbec-b80c441a885d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2151edcc-847c-4e59-a412-ae28e86aedaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2151edcc-847c-4e59-a412-ae28e86aedaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f17327-ed03-4a33-b2d2-573e40ac58cc', 'volume_name': 'volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942b4c2f-96b2-46db-9d30-71564c256c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942b4c2f-96b2-46db-9d30-71564c256c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e828ebc-ff76-4452-b2c4-7db909f0f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:55 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Volume b5f17327-ed03-4a33-b2d2-573e40ac58cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc', 'volume_size': 1} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1627541607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f17327-ed03-4a33-b2d2-573e40ac58cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5181038a424f9ea6667e5a0a8d65c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:55Z,use_quota=True,user_id='fb333cddee1947d2adeb0b27e916180f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Creating volume b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:55 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:35:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc 1073741824 Nov 06 21:35:55 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (41f30d13-4d3b-40ba-a581-1f3c941ced06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f58df80-5649-4875-bc10-e7b1636053e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc 1073741824" returned: 0 in 0.647s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f58df80-5649-4875-bc10-e7b1636053e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-449545423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6e0413-390c-4be6-9910-6086238c94ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:56Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac87ac8-a945-4de2-bc79-829fb599091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac87ac8-a945-4de2-bc79-829fb599091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004f6208-d72f-4a9d-b3ee-c1a4301b5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004f6208-d72f-4a9d-b3ee-c1a4301b5330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6e0413-390c-4be6-9910-6086238c94ed', 'volume_name': 'volume-fe6e0413-390c-4be6-9910-6086238c94ed', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a725bf94-b2dd-4b65-bb51-712be323d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a725bf94-b2dd-4b65-bb51-712be323d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf7ea72-b2a8-4b48-b99e-1770dc14a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Volume fe6e0413-390c-4be6-9910-6086238c94ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6e0413-390c-4be6-9910-6086238c94ed', 'volume_size': 1} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc Nov 06 21:35:56 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc" returned: 0 in 0.438s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-449545423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6e0413-390c-4be6-9910-6086238c94ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:56Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Creating volume fe6e0413-390c-4be6-9910-6086238c94ed {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:56 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:56 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed 1073741824 Nov 06 21:35:56 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (9069b8a1-bd20-4d73-9865-9170b193f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c303f73c-ce3c-46d3-a564-9b7aad0596c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e828ebc-ff76-4452-b2c4-7db909f0f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25b8986-35ee-4066-9ddc-352f0221b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c303f73c-ce3c-46d3-a564-9b7aad0596c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-939307306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:57Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1afbad2-9df7-4996-a3ba-da6bad92be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1afbad2-9df7-4996-a3ba-da6bad92be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f808ea4a-6532-438c-864f-550a58fcfde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f808ea4a-6532-438c-864f-550a58fcfde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52', 'volume_name': 'volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700a2eef-b960-4b85-9e1c-d99b3a86ad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700a2eef-b960-4b85-9e1c-d99b3a86ad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c429e1-e720-4e85-85b7-6cccee5e48bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:56 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Volume 9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52', 'volume_size': 1} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:56 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Volume volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc (b5f17327-ed03-4a33-b2d2-573e40ac58cc): created successfully Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25b8986-35ee-4066-9ddc-352f0221b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:56 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Flow 'volume_create_manager' (3ad05c47-a436-492a-b5c0-aa139195e553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:56 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-029c6d4d-1d01-426b-85c4-b9087ea9d8fe tempest-VolumeDependencyTests-245884239 None] Created volume successfully. Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (0870b6cc-3cdf-495d-8178-bf9a4f8c91a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8391d5-a503-421a-bdaa-1f4fe4f308e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8391d5-a503-421a-bdaa-1f4fe4f308e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-910739716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3798f011-855e-4414-81e3-dd9f665a39b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:57Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb606e8-3b97-46f5-9134-bc5de8d8ea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb606e8-3b97-46f5-9134-bc5de8d8ea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754ba2c1-aed6-49bc-93c5-f527ccf526e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754ba2c1-aed6-49bc-93c5-f527ccf526e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3798f011-855e-4414-81e3-dd9f665a39b3', 'volume_name': 'volume-3798f011-855e-4414-81e3-dd9f665a39b3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8d3a0f-f69a-4fd0-afa5-00670d5ad0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8d3a0f-f69a-4fd0-afa5-00670d5ad0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88350bdb-e7d6-46cb-b72e-e9c9e00f6ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Volume 3798f011-855e-4414-81e3-dd9f665a39b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3798f011-855e-4414-81e3-dd9f665a39b3', 'volume_size': 1} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:57 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed 1073741824" returned: 0 in 0.642s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:57 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed Nov 06 21:35:57 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:57 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (5dde44d1-623e-4d1f-9000-479986d6ee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f75a60a-9aed-47a7-9b3b-67e98340c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed" returned: 0 in 0.455s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-939307306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:57Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Creating volume 9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:57 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f75a60a-9aed-47a7-9b3b-67e98340c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1807862268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aa0c97-0782-46a6-9b62-57742c7056a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:58Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ee034b-dd48-413d-a9df-0b1120bb2125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 1073741824 Nov 06 21:35:57 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:57 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ee034b-dd48-413d-a9df-0b1120bb2125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1e8df8-bcb2-4013-86b0-db4c1809711b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1e8df8-bcb2-4013-86b0-db4c1809711b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aa0c97-0782-46a6-9b62-57742c7056a0', 'volume_name': 'volume-d0aa0c97-0782-46a6-9b62-57742c7056a0', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d671d528-1fe7-49d2-b9b3-46d02fb631f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d671d528-1fe7-49d2-b9b3-46d02fb631f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d7f416-680f-4e67-a2be-0d0809b5f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Volume d0aa0c97-0782-46a6-9b62-57742c7056a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aa0c97-0782-46a6-9b62-57742c7056a0', 'volume_size': 1} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf7ea72-b2a8-4b48-b99e-1770dc14a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6e0413-390c-4be6-9910-6086238c94ed', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f06dc-966c-4983-9a5e-2c4da0571293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Volume volume-fe6e0413-390c-4be6-9910-6086238c94ed (fe6e0413-390c-4be6-9910-6086238c94ed): created successfully Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f06dc-966c-4983-9a5e-2c4da0571293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (41f30d13-4d3b-40ba-a581-1f3c941ced06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-462adfa3-0a1f-4eb2-8deb-e5da2f83491a tempest-CreateVolumesFromImageTest-1659281201 None] Created volume successfully. Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (870b26a4-7bae-4c1d-a63d-a65c15501f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989c2f65-45bc-40be-8659-a49c0e7ed15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989c2f65-45bc-40be-8659-a49c0e7ed15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225124008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867ace75-36a9-4e24-bca6-eb4ad7d8eeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:58Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1af01d0-4aec-4039-b870-78d8357d9c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1af01d0-4aec-4039-b870-78d8357d9c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a5243c-b0bf-4dcd-8a26-59f387afdcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a5243c-b0bf-4dcd-8a26-59f387afdcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867ace75-36a9-4e24-bca6-eb4ad7d8eeaa', 'volume_name': 'volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234523a6-9dd5-4705-b31a-39f6307013a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234523a6-9dd5-4705-b31a-39f6307013a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b90af8-3b91-469b-af28-eef85661ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Volume 867ace75-36a9-4e24-bca6-eb4ad7d8eeaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa', 'volume_size': 1} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 1073741824" returned: 0 in 0.659s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 Nov 06 21:35:58 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52" returned: 0 in 0.271s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-910739716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3798f011-855e-4414-81e3-dd9f665a39b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:57Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Creating volume 3798f011-855e-4414-81e3-dd9f665a39b3 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:58 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c429e1-e720-4e85-85b7-6cccee5e48bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b1d27-b5c6-43d3-846e-daf71363b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 1073741824 Nov 06 21:35:58 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Volume volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 (9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52): created successfully Nov 06 21:35:58 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b1d27-b5c6-43d3-846e-daf71363b6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (9069b8a1-bd20-4d73-9865-9170b193f27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-88e97695-2f0a-4d0d-9ac2-5907bf494af3 tempest-CreateVolumesFromImageTest-1659281201 None] Created volume successfully. Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Flow 'volume_create_manager' (db10cec6-6acb-43e6-8fde-f62e6691940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:59 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da147e8-7026-499e-805d-5be51461be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 1073741824" returned: 0 in 0.561s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da147e8-7026-499e-805d-5be51461be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527af706-8663-4062-bf87-8ffb649b935d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7500bb521a14377bf27210548c26b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:59Z,use_quota=True,user_id='15a088aeabd148ee989311fa4d8b919a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b3c7a7-8b44-46b0-9218-fd35cffa7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b3c7a7-8b44-46b0-9218-fd35cffa7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53def82-f24f-4da8-8b99-4370e143d803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 Nov 06 21:35:59 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3" returned: 0 in 0.308s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1807862268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aa0c97-0782-46a6-9b62-57742c7056a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:58Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Creating volume d0aa0c97-0782-46a6-9b62-57742c7056a0 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:59 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88350bdb-e7d6-46cb-b72e-e9c9e00f6ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3798f011-855e-4414-81e3-dd9f665a39b3', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 1073741824 Nov 06 21:35:59 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791a1fcf-4e68-42cf-990c-7209d4c373e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53def82-f24f-4da8-8b99-4370e143d803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '527af706-8663-4062-bf87-8ffb649b935d', 'volume_name': 'volume-527af706-8663-4062-bf87-8ffb649b935d', 'volume_size': 1, 'image_id': '1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61cb60726c668ac5702533d028f0c132', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7500bb521a14377bf27210548c26b76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '086582f09fbbc9df1ecf3563090068aec60bfed02e4e78b8bbd3282e9e835b8328d8bede4051cafe1dd75e89bac3336b004b1f5df67c29bab368c3979ddddcb6', 'id': '1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14/file', 'properties': {}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76274674-da35-43b9-807b-2a6aa13c982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76274674-da35-43b9-807b-2a6aa13c982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1e9fb7-332f-4e74-bf29-a5bee1d2b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:59 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Volume 527af706-8663-4062-bf87-8ffb649b935d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-527af706-8663-4062-bf87-8ffb649b935d', 'volume_size': 1, 'image_id': '1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61cb60726c668ac5702533d028f0c132', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7500bb521a14377bf27210548c26b76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '086582f09fbbc9df1ecf3563090068aec60bfed02e4e78b8bbd3282e9e835b8328d8bede4051cafe1dd75e89bac3336b004b1f5df67c29bab368c3979ddddcb6', 'id': '1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14/file', 'properties': {}}, 'image_service': } Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Trying to clone 527af706-8663-4062-bf87-8ffb649b935d from image 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:35:59 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Volume volume-3798f011-855e-4414-81e3-dd9f665a39b3 (3798f011-855e-4414-81e3-dd9f665a39b3): created successfully Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791a1fcf-4e68-42cf-990c-7209d4c373e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (0870b6cc-3cdf-495d-8178-bf9a4f8c91a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6e726927-3788-41ed-8b4b-a49cb8c609be tempest-CreateVolumesFromImageTest-1659281201 None] Created volume successfully. Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:36:00 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cdc41e-29ac-48d8-89d6-9b45412f461a]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:00 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD Nov 06 21:36:00 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:00 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 1073741824" returned: 0 in 0.601s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:00 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:00 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 Nov 06 21:36:00 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Flow 'volume_create_manager' (b0b2b6ab-5f93-4f27-8f1c-84fa7f2cfe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54df4657-9d7f-443b-9521-5183fa8872f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54df4657-9d7f-443b-9521-5183fa8872f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8b6bba-d4b4-4252-ad46-5d567853b16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ab9525e8c54ff387a679006f8dddd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:01Z,use_quota=True,user_id='ff418d047ef044198afaab88b0eea6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e5c2f3-39de-40a5-a6a7-1a154640c6ba),volume_type_id=50e5c2f3-39de-40a5-a6a7-1a154640c6ba)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab91f2f-1dce-4ca3-9834-ba97bcc4d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab91f2f-1dce-4ca3-9834-ba97bcc4d288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd8dc39-c28d-437d-ad46-e4fdfeb9613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.image.glance [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Creating Keystone auth plugin from conf {{(pid=87450) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:36:00 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD Nov 06 21:36:00 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:00 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0" returned: 0 in 0.321s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.764s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Creating offline snapshot 0e321901-c6c8-4631-a34a-190c15c88e7d of volume b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d7f416-680f-4e67-a2be-0d0809b5f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aa0c97-0782-46a6-9b62-57742c7056a0', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5a6739-00b8-4a20-9ca6-3ad1c17aadc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ae0e7f-ada8-48df-a47f-57b8b7ae6315]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:00 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Temporary image 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 is fetched for user 15a088aeabd148ee989311fa4d8b919a. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd8dc39-c28d-437d-ad46-e4fdfeb9613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a8b6bba-d4b4-4252-ad46-5d567853b16b', 'volume_name': 'volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b', 'volume_size': 1, 'image_id': '9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce2df5741d22a68207e4b943acc8e287', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19ab9525e8c54ff387a679006f8dddd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8193913c317df576aa18035f63373181c2dbc0777d1873316be4f5ab0f164bf6e389b41cb51c0b2b45008fd712d5ecd9a02e5fd5a174ebbf770c89593689e4b5', 'id': '9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad28251c-8042-4aa5-bd64-ea9f2be9dc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad28251c-8042-4aa5-bd64-ea9f2be9dc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580fa6ef-74c0-4ee1-bc1f-d80358aa2539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Volume 5a8b6bba-d4b4-4252-ad46-5d567853b16b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b', 'volume_size': 1, 'image_id': '9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce2df5741d22a68207e4b943acc8e287', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19ab9525e8c54ff387a679006f8dddd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8193913c317df576aa18035f63373181c2dbc0777d1873316be4f5ab0f164bf6e389b41cb51c0b2b45008fd712d5ecd9a02e5fd5a174ebbf770c89593689e4b5', 'id': '9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Trying to clone 5a8b6bba-d4b4-4252-ad46-5d567853b16b from image 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'metadata': {}}]). {{(pid=87450) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:36:00 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Volume volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 (d0aa0c97-0782-46a6-9b62-57742c7056a0): created successfully Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5a6739-00b8-4a20-9ca6-3ad1c17aadc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (5dde44d1-623e-4d1f-9000-479986d6ee1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:01 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-84ecf3d9-4ac5-4a70-b71d-1440076814de tempest-CreateVolumesFromImageTest-1659281201 None] Created volume successfully. Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df175b-a915-4cef-a200-d2d6461795c8]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc Nov 06 21:36:01 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:36:01 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88e2222-6258-47d9-9ed6-3c2ec5ba58bf]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD Nov 06 21:36:01 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD Nov 06 21:36:01 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc" returned: 0 in 0.451s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d 1G Nov 06 21:36:01 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD Nov 06 21:36:01 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD Nov 06 21:36:01 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:01 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d 1G" returned: 0 in 0.527s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d Nov 06 21:36:01 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Temporary image 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 is fetched for user ff418d047ef044198afaab88b0eea6d7. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:36:01 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f21010-c3ab-4668-a954-8b0d7c6577ac]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:02 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD Nov 06 21:36:02 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:02 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d" returned: 0 in 0.298s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d is being set with open permissions: ugo+rw Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:02 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d Nov 06 21:36:02 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:02 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:02 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD Nov 06 21:36:02 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:02 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d" returned: 0 in 0.278s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:02 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.info Nov 06 21:36:02 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:02 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:02 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.info" returned: 0 in 0.279s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.info is being set with open permissions: ugo+rw Nov 06 21:36:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:02 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.info Nov 06 21:36:02 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:03 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.info" returned: 0 in 0.276s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.632s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225124008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867ace75-36a9-4e24-bca6-eb4ad7d8eeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9127d87afe4cc5afa37c9c9ef8262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:58Z,use_quota=True,user_id='946656e99e7b4d748be8e2c7dc8b50d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Creating volume 867ace75-36a9-4e24-bca6-eb4ad7d8eeaa {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:03 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:03 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa 1073741824 Nov 06 21:36:03 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1250e2d6-f88a-4c61-87f2-8ace7feabb86 tempest-VolumeDependencyTests-245884239 None] Create snapshot completed successfully Nov 06 21:36:03 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa 1073741824" returned: 0 in 0.479s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:03 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa Nov 06 21:36:03 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:03 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa" returned: 0 in 0.259s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.993s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527af706-8663-4062-bf87-8ffb649b935d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7500bb521a14377bf27210548c26b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:59Z,use_quota=True,user_id='15a088aeabd148ee989311fa4d8b919a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Creating volume 527af706-8663-4062-bf87-8ffb649b935d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:03 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b90af8-3b91-469b-af28-eef85661ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7448673-2dce-415f-8eb2-64a1e57dbe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:03 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d 1073741824 Nov 06 21:36:03 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:03 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Volume volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa (867ace75-36a9-4e24-bca6-eb4ad7d8eeaa): created successfully Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7448673-2dce-415f-8eb2-64a1e57dbe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Flow 'volume_create_manager' (870b26a4-7bae-4c1d-a63d-a65c15501f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:03 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fbafff81-ca71-4bc0-acaa-63cfd12d4802 tempest-CreateVolumesFromImageTest-1659281201 None] Created volume successfully. Nov 06 21:36:04 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d 1073741824" returned: 0 in 0.462s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:04 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d Nov 06 21:36:04 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:04 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d" returned: 0 in 0.294s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.988s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8b6bba-d4b4-4252-ad46-5d567853b16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ab9525e8c54ff387a679006f8dddd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:01Z,use_quota=True,user_id='ff418d047ef044198afaab88b0eea6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e5c2f3-39de-40a5-a6a7-1a154640c6ba),volume_type_id=50e5c2f3-39de-40a5-a6a7-1a154640c6ba)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Creating volume 5a8b6bba-d4b4-4252-ad46-5d567853b16b {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:04 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:04 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b 1073741824 Nov 06 21:36:04 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Attempting download of 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'metadata': {}}])) to volume 527af706-8663-4062-bf87-8ffb649b935d. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b4488-2167-4e91-9756-c5ce322f4516]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_m50sa4w2 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Flow 'volume_create_manager' (a1c43587-c656-48f1-aa4b-6f3ec929c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c42911b-6107-41fd-ae12-759120710122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c42911b-6107-41fd-ae12-759120710122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-261845127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ccd7bf-458b-4715-9429-a0d276ee4087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5181038a424f9ea6667e5a0a8d65c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e321901-c6c8-4631-a34a-190c15c88e7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:05Z,use_quota=True,user_id='fb333cddee1947d2adeb0b27e916180f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_m50sa4w2 Nov 06 21:36:04 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e347d1-f24a-4ac9-9b91-997277e60218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e347d1-f24a-4ac9-9b91-997277e60218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240ac34e-5448-4a8d-aef9-f79881efc5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240ac34e-5448-4a8d-aef9-f79881efc5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88ccd7bf-458b-4715-9429-a0d276ee4087', 'volume_name': 'volume-88ccd7bf-458b-4715-9429-a0d276ee4087', 'volume_size': 1, 'snapshot_id': '0e321901-c6c8-4631-a34a-190c15c88e7d'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a38cb3-82d5-4804-a785-dd4b531d3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a38cb3-82d5-4804-a785-dd4b531d3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dada78ab-afcc-469f-a64a-bf36417a6889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Volume 88ccd7bf-458b-4715-9429-a0d276ee4087: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88ccd7bf-458b-4715-9429-a0d276ee4087', 'volume_size': 1, 'snapshot_id': '0e321901-c6c8-4631-a34a-190c15c88e7d'} Nov 06 21:36:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-quobyte-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b73aaf-aa43-4154-8865-385224787dfd]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_m50sa4w2" returned: 0 in 0.425s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_m50sa4w2 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b 1073741824" returned: 0 in 0.580s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa Nov 06 21:36:05 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_m50sa4w2 Nov 06 21:36:05 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b Nov 06 21:36:05 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_m50sa4w2" returned: 1 in 0.355s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_m50sa4w2' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4285a537-7507-4ad4-a20b-1faf74c7d391]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b" returned: 0 in 0.282s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.617s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-quobyte-0e321901-c6c8-4631-a34a-190c15c88e7d-88ccd7bf-458b-4715-9429-a0d276ee4087" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa" returned: 0 in 0.458s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-0e321901-c6c8-4631-a34a-190c15c88e7d-88ccd7bf-458b-4715-9429-a0d276ee4087" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Creating volume 88ccd7bf-458b-4715-9429-a0d276ee4087 from snapshot 0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-quobyte-88ccd7bf-458b-4715-9429-a0d276ee4087" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:05 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa Nov 06 21:36:05 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Attempting download of 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'metadata': {}}])) to volume 5a8b6bba-d4b4-4252-ad46-5d567853b16b. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:36:05 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD Nov 06 21:36:05 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-88ccd7bf-458b-4715-9429-a0d276ee4087" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] snapshot: 0e321901-c6c8-4631-a34a-190c15c88e7d, volume: 88ccd7bf-458b-4715-9429-a0d276ee4087, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca42f8-6f72-4397-8f97-aed7e3779994]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c7972-b72c-467e-96ef-b847d4279ecb]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_4j5an62i {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d Nov 06 21:36:05 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa" returned: 0 in 0.314s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_4j5an62i Nov 06 21:36:05 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa" released by "delete_volume" :: held 0.830s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:05 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Created reservations ['19909c37-8152-466e-b9a3-03c542789753', '453e758f-f47e-44ef-80ae-6d68302cd1df', '8c531f1d-4b1c-4e59-a1cd-93e8f1e37d57', '080f10ca-7192-469d-9714-b7d7b68db207'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:06 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD Nov 06 21:36:06 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:06 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_4j5an62i" returned: 0 in 0.420s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_4j5an62i {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d" returned: 0 in 0.474s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f8f91-51f9-4480-a731-9b666bbadb0c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-d0aa0c97-0782-46a6-9b62-57742c7056a0-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-d0aa0c97-0782-46a6-9b62-57742c7056a0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:06 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 was raw, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_4j5an62i Nov 06 21:36:06 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d Nov 06 21:36:06 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-quobyte-d0aa0c97-0782-46a6-9b62-57742c7056a0" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-d0aa0c97-0782-46a6-9b62-57742c7056a0" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:06 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc Nov 06 21:36:06 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b488489-9031-4300-b8e6-214789dd0551]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.409s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:06 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Deleted volume successfully. Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9d924006-bb8c-4e12-a865-4a2b2711fd99 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-867ace75-36a9-4e24-bca6-eb4ad7d8eeaa-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:06 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 Nov 06 21:36:06 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_4j5an62i" returned: 1 in 0.474s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_4j5an62i' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[974673a4-a5f8-4691-bdf5-d26979802ac8]: (4, 'raw') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc" returned: 0 in 0.514s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:36:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 Nov 06 21:36:06 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD Nov 06 21:36:06 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d" returned: 0 in 0.604s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c63fd93-d9aa-4002-a3bf-2153e00b0a14_o_m98fcmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:36:07 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0" returned: 0 in 0.495s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d 1G Nov 06 21:36:07 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0 Nov 06 21:36:07 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD Nov 06 21:36:07 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d0aa0c97-0782-46a6-9b62-57742c7056a0" returned: 0 in 0.312s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-d0aa0c97-0782-46a6-9b62-57742c7056a0" released by "delete_volume" :: held 0.873s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Created reservations ['e1dd0313-9f35-40db-ac0b-5b66a4b2e7b0', 'c159056b-be96-4b0e-836a-9540f6884610', '89c425e4-414c-4c5b-9816-2291e74198fe', 'e17ce317-bec2-4a2b-8ff1-88795ea1b93e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:07 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d 1G" returned: 0 in 0.477s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Downloaded image 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'metadata': {}}])) to volume 527af706-8663-4062-bf87-8ffb649b935d successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Temporary image 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 for user 15a088aeabd148ee989311fa4d8b919a is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Marking volume 527af706-8663-4062-bf87-8ffb649b935d as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Copying metadata from image 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 to 527af706-8663-4062-bf87-8ffb649b935d. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Creating volume glance metadata for volume 527af706-8663-4062-bf87-8ffb649b935d backed by image 1c63fd93-d9aa-4002-a3bf-2153e00b0a14 with: {'image_id': '1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '61cb60726c668ac5702533d028f0c132', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:07 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD" returned: 1 in 0.536s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 was raw, converting to qcow2 {{(pid=87450) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:36:07 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-3798f011-855e-4414-81e3-dd9f665a39b3-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:07 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b Nov 06 21:36:07 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-3798f011-855e-4414-81e3-dd9f665a39b3-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1e9fb7-332f-4e74-bf29-a5bee1d2b50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527af706-8663-4062-bf87-8ffb649b935d', 'volume_size': 1, 'image_id': '1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61cb60726c668ac5702533d028f0c132', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7500bb521a14377bf27210548c26b76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '086582f09fbbc9df1ecf3563090068aec60bfed02e4e78b8bbd3282e9e835b8328d8bede4051cafe1dd75e89bac3336b004b1f5df67c29bab368c3979ddddcb6', 'id': '1c63fd93-d9aa-4002-a3bf-2153e00b0a14', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c63fd93-d9aa-4002-a3bf-2153e00b0a14/file', 'properties': {}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc2c1de-9621-4947-9e86-724ff11f546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:07 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Volume volume-527af706-8663-4062-bf87-8ffb649b935d (527af706-8663-4062-bf87-8ffb649b935d): created successfully Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc2c1de-9621-4947-9e86-724ff11f546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:07 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Flow 'volume_create_manager' (db10cec6-6acb-43e6-8fde-f62e6691940f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-quobyte-3798f011-855e-4414-81e3-dd9f665a39b3" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f475f412-fb61-4d7a-9658-c92bee1a68b0 tempest-VolumeImageDependencyTests-1960617578 None] Created volume successfully. Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-3798f011-855e-4414-81e3-dd9f665a39b3" acquired by "delete_volume" :: waited 0.055s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7c5f3-8bb4-4d38-b640-a1e2890a41b0]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.595s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Deleted volume successfully. Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b7f938d7-9294-419b-9625-c9812f2f4670 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-d0aa0c97-0782-46a6-9b62-57742c7056a0-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:08 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 Nov 06 21:36:08 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3" returned: 0 in 0.585s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3 Nov 06 21:36:08 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b" returned: 0 in 1.185s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e33cbbe-9719-4757-bf1b-6d0c5750fde1_a7a142d5devstack@QuobyteHD, size 0.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:36:08 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:36:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b 1G Nov 06 21:36:08 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3798f011-855e-4414-81e3-dd9f665a39b3" returned: 0 in 0.439s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-3798f011-855e-4414-81e3-dd9f665a39b3" released by "delete_volume" :: held 1.159s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Created reservations ['59cfc1e8-9f6b-4cc1-82a5-e06c93ff5e78', 'da5d6df7-f06f-41f5-a3bd-9f6c03203157', '07f1ed5e-6434-42ab-9181-8856b4822b58', '39eed936-a78f-4d33-a000-7a350ecfde74'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Acquiring lock "cinder-527af706-8663-4062-bf87-8ffb649b935d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Lock "cinder-527af706-8663-4062-bf87-8ffb649b935d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Acquiring lock "cinder-quobyte-527af706-8663-4062-bf87-8ffb649b935d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:09 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:09 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Lock "cinder-quobyte-527af706-8663-4062-bf87-8ffb649b935d" acquired by "delete_volume" :: waited 0.037s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[088e0851-dc79-42af-864c-88f4755700ac]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b 1G" returned: 0 in 1.051s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Downloaded image 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'metadata': {}}])) to volume 5a8b6bba-d4b4-4252-ad46-5d567853b16b successfully. {{(pid=87450) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Temporary image 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 for user ff418d047ef044198afaab88b0eea6d7 is deleted. {{(pid=87450) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:36:09 devstack cinder-volume[87450]: DEBUG cinder.volume.volume_utils [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Marking volume 5a8b6bba-d4b4-4252-ad46-5d567853b16b as bootable. {{(pid=87450) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Copying metadata from image 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 to 5a8b6bba-d4b4-4252-ad46-5d567853b16b. {{(pid=87450) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Creating volume glance metadata for volume 5a8b6bba-d4b4-4252-ad46-5d567853b16b backed by image 9e33cbbe-9719-4757-bf1b-6d0c5750fde1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ce2df5741d22a68207e4b943acc8e287', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87450) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:36:10 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d Nov 06 21:36:10 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:10 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.429s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Deleted volume successfully. Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a93f57fa-3901-4f9e-9317-798040ae5897 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-3798f011-855e-4414-81e3-dd9f665a39b3-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580fa6ef-74c0-4ee1-bc1f-d80358aa2539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b', 'volume_size': 1, 'image_id': '9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce2df5741d22a68207e4b943acc8e287', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19ab9525e8c54ff387a679006f8dddd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8193913c317df576aa18035f63373181c2dbc0777d1873316be4f5ab0f164bf6e389b41cb51c0b2b45008fd712d5ecd9a02e5fd5a174ebbf770c89593689e4b5', 'id': '9e33cbbe-9719-4757-bf1b-6d0c5750fde1', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e33cbbe-9719-4757-bf1b-6d0c5750fde1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aa3cc0-4fed-42c0-b520-c81bfce3fba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:10 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Volume volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b (5a8b6bba-d4b4-4252-ad46-5d567853b16b): created successfully Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aa3cc0-4fed-42c0-b520-c81bfce3fba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Flow 'volume_create_manager' (b0b2b6ab-5f93-4f27-8f1c-84fa7f2cfe66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:10 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ad106ccf-f27b-4b39-b876-b41c0fe5d3b6 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Created volume successfully. Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-quobyte-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52" acquired by "delete_volume" :: waited 0.040s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:10 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d" returned: 0 in 0.853s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad27ea-b7af-4137-baaa-057331b2fc9c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:10 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d Nov 06 21:36:10 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:10 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 Nov 06 21:36:10 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Acquiring lock "cinder-5a8b6bba-d4b4-4252-ad46-5d567853b16b-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:11 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:11 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "cinder-5a8b6bba-d4b4-4252-ad46-5d567853b16b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:11 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-527af706-8663-4062-bf87-8ffb649b935d" returned: 0 in 0.647s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Lock "cinder-quobyte-527af706-8663-4062-bf87-8ffb649b935d" released by "delete_volume" :: held 1.680s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Acquiring lock "cinder-quobyte-5a8b6bba-d4b4-4252-ad46-5d567853b16b" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "cinder-quobyte-5a8b6bba-d4b4-4252-ad46-5d567853b16b" acquired by "delete_volume" :: waited 0.077s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e65af-cd8f-4173-a561-be81d5441c9e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:11 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.513s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Created reservations ['3749cf41-6bcd-4c1f-b79d-f8d47a328ed5', '263f0954-cf2f-4074-965a-384e7efe9e60', '4dbf9008-2b86-4221-9aac-dc3e04b0b2e2', 'cb1289bb-b30a-45eb-be27-36e006e169a1'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:11 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52" returned: 0 in 1.086s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:11 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52 Nov 06 21:36:11 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:11 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b Nov 06 21:36:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:11 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:12 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:12 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:12 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.530s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:12 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Deleted volume successfully. Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e37d91b7-0cd5-47bd-9afa-4bc752219ed6 tempest-VolumeImageDependencyTests-1960617578 None] Lock "cinder-527af706-8663-4062-bf87-8ffb649b935d-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:12 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52" returned: 0 in 0.903s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52" released by "delete_volume" :: held 2.193s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:12 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b" returned: 0 in 1.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:12 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Created reservations ['ff709665-d740-4362-bd4b-7b062d041119', '1457c536-18e3-4b92-9956-5c6f79b183d6', '73d9e40c-67dd-4d11-8d1d-84e04b1db375', '279455f3-92ce-4ae7-8797-5e19d000bb97'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:12 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b Nov 06 21:36:12 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:13 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:13 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:13 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-5a8b6bba-d4b4-4252-ad46-5d567853b16b" returned: 0 in 0.592s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "cinder-quobyte-5a8b6bba-d4b4-4252-ad46-5d567853b16b" released by "delete_volume" :: held 2.024s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:13 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.442s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Deleted volume successfully. Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-f4801de1-55de-4140-b4e0-1ec7b7918bbc tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-9bcd2ba7-9b58-42a0-a9fd-ed25ca6c1b52-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Created reservations ['be75a6ac-128a-4c8a-a1d0-c452636c41a8', 'fba2c7cf-bd19-45e9-a593-2b366bcc3673', 'da0bb67d-34d8-4e71-a1a3-8eeada21378c', '7d718203-6523-4b8c-8444-0827949ca55f'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:13 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:13 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-fe6e0413-390c-4be6-9910-6086238c94ed-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-fe6e0413-390c-4be6-9910-6086238c94ed-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "cinder-quobyte-fe6e0413-390c-4be6-9910-6086238c94ed" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-fe6e0413-390c-4be6-9910-6086238c94ed" acquired by "delete_volume" :: waited 0.059s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ba230-2d45-400a-8c40-d94b508479be]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:14 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.539s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:14 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Deleted volume successfully. Nov 06 21:36:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0517b5be-80ea-43a3-b839-d2c2548884f3 tempest-VolumeAndVolumeTypeFromImageTest-539032412 None] Lock "cinder-5a8b6bba-d4b4-4252-ad46-5d567853b16b-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:14 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed Nov 06 21:36:14 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:15 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed" returned: 0 in 0.766s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:15 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed Nov 06 21:36:15 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:15 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe6e0413-390c-4be6-9910-6086238c94ed" returned: 0 in 0.738s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:15 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-quobyte-fe6e0413-390c-4be6-9910-6086238c94ed" released by "delete_volume" :: held 1.630s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:15 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Created reservations ['ee96bc0f-923f-4146-bad8-7e1cdda1cbb0', '66cacc31-cdbe-4c1e-b1a8-80f424e8b6e2', 'd31b3554-dc3d-4308-b503-cc0b14b76460', '0a852fa3-0acd-4c54-b6e9-41839416b730'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:16 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:16 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:16 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087" returned: 0 in 9.615s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc, size 1024.00 MB, duration 9.62 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:36:16 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Converted 1024.00 MB image at 106.48 MB/s Nov 06 21:36:16 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 is being set with open permissions: ugo+rw Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:16 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 Nov 06 21:36:16 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:16 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.462s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Deleted volume successfully. Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a4505640-7f14-480e-a841-c3225a09cb33 tempest-CreateVolumesFromImageTest-1659281201 None] Lock "cinder-fe6e0413-390c-4be6-9910-6086238c94ed-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:16 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087" returned: 0 in 0.319s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-88ccd7bf-458b-4715-9429-a0d276ee4087" released by "_copy_volume_from_snapshot" :: held 11.069s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-0e321901-c6c8-4631-a34a-190c15c88e7d-88ccd7bf-458b-4715-9429-a0d276ee4087" released by "_create_volume_from_snapshot" :: held 11.173s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.210s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dada78ab-afcc-469f-a64a-bf36417a6889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ccd7bf-458b-4715-9429-a0d276ee4087', 'volume_size': 1, 'snapshot_id': '0e321901-c6c8-4631-a34a-190c15c88e7d'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a490c63-b23e-4c0f-980e-ed5eac8b59c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Volume volume-88ccd7bf-458b-4715-9429-a0d276ee4087 (88ccd7bf-458b-4715-9429-a0d276ee4087): created successfully Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a490c63-b23e-4c0f-980e-ed5eac8b59c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Flow 'volume_create_manager' (a1c43587-c656-48f1-aa4b-6f3ec929c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-db0ffe99-6711-4468-98f9-ba92c9d002af tempest-VolumeDependencyTests-245884239 None] Created volume successfully. Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-0e321901-c6c8-4631-a34a-190c15c88e7d-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-0e321901-c6c8-4631-a34a-190c15c88e7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-quobyte-b5f17327-ed03-4a33-b2d2-573e40ac58cc" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-b5f17327-ed03-4a33-b2d2-573e40ac58cc" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-quobyte-0e321901-c6c8-4631-a34a-190c15c88e7d" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-0e321901-c6c8-4631-a34a-190c15c88e7d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Deleting offline snapshot 0e321901-c6c8-4631-a34a-190c15c88e7d of volume b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] snapshot_file for this snap is: volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[72105d2c-6ab5-4dd0-b934-d926c1dd94c4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:17 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d Nov 06 21:36:17 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d" returned: 0 in 0.520s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:17 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:17 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4937b9c-ff0f-46b3-a6a3-3264b9e71baa]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:18 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc Nov 06 21:36:18 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Flow 'volume_create_manager' (21195f16-14d8-4dd7-b360-9118eb5223b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a843eaf2-f64f-45f5-97be-24fbe1fcec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a843eaf2-f64f-45f5-97be-24fbe1fcec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770510c6-144e-4220-a790-c49cf16fa3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a4f0167bd94955993330d886b17b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:19Z,use_quota=True,user_id='6aa46584c2ed402ea3e42b7962ae5e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffc9ae2-e7f1-4c75-80a2-5354ca150b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffc9ae2-e7f1-4c75-80a2-5354ca150b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:18 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe131e3-33c3-4447-bdf2-20a152e05335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe131e3-33c3-4447-bdf2-20a152e05335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770510c6-144e-4220-a790-c49cf16fa3db', 'volume_name': 'volume-770510c6-144e-4220-a790-c49cf16fa3db', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58566161-ebc3-4ceb-9444-0ed9fbaad11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58566161-ebc3-4ceb-9444-0ed9fbaad11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cdf5d1-591e-4642-8b12-52b1b2a35ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:18 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Volume 770510c6-144e-4220-a790-c49cf16fa3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770510c6-144e-4220-a790-c49cf16fa3db', 'volume_size': 1} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770510c6-144e-4220-a790-c49cf16fa3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a4f0167bd94955993330d886b17b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:19Z,use_quota=True,user_id='6aa46584c2ed402ea3e42b7962ae5e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Creating volume 770510c6-144e-4220-a790-c49cf16fa3db {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:18 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc" returned: 0 in 0.925s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:18 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db 1073741824 Nov 06 21:36:18 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:18 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d Nov 06 21:36:18 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:19 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d" returned: 0 in 0.434s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:19 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d Nov 06 21:36:19 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:19 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db 1073741824" returned: 0 in 0.552s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:19 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db Nov 06 21:36:19 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:19 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc.0e321901-c6c8-4631-a34a-190c15c88e7d" returned: 0 in 0.376s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-0e321901-c6c8-4631-a34a-190c15c88e7d" released by "_delete_snapshot" :: held 2.446s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-b5f17327-ed03-4a33-b2d2-573e40ac58cc" released by "delete_snapshot" :: held 2.483s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Created reservations ['29c65c5f-fddf-4b56-8498-9340961aac66', 'fc9b8604-27c1-42fe-974e-1aa4eb5be60f', '022d7622-d7ae-4e03-9acd-65d0778669c9', '37773aa5-0468-45ea-bdda-1c9cb7f81f16'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:19 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db" returned: 0 in 0.353s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cdf5d1-591e-4642-8b12-52b1b2a35ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770510c6-144e-4220-a790-c49cf16fa3db', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fc0f96-bb8c-4277-bf3c-062fdcd5940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:19 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Volume volume-770510c6-144e-4220-a790-c49cf16fa3db (770510c6-144e-4220-a790-c49cf16fa3db): created successfully Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fc0f96-bb8c-4277-bf3c-062fdcd5940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Flow 'volume_create_manager' (21195f16-14d8-4dd7-b360-9118eb5223b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:19 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c852a8b8-9835-4a48-9f60-c3d18dd369d7 tempest-CinderUnicodeTest-2098448608 None] Created volume successfully. Nov 06 21:36:19 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Delete snapshot completed successfully. Nov 06 21:36:19 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6120564d-2afb-4b49-9b88-fa9be610e790 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-0e321901-c6c8-4631-a34a-190c15c88e7d-delete_snapshot" released by "delete_snapshot" :: held 2.703s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-b5f17327-ed03-4a33-b2d2-573e40ac58cc-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Lock "cinder-b5f17327-ed03-4a33-b2d2-573e40ac58cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-quobyte-b5f17327-ed03-4a33-b2d2-573e40ac58cc" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-b5f17327-ed03-4a33-b2d2-573e40ac58cc" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[97414483-9fa5-4c49-b4c2-b4348aab9a53]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:20 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc Nov 06 21:36:20 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (664a5fcd-2e2d-496b-b7ba-2d9a359bab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517fec37-2aa6-42fa-aea0-49f7e3e024d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517fec37-2aa6-42fa-aea0-49f7e3e024d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062579186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8b8664-a205-432e-9c6c-fb17faefd1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:21Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40535e5-b77e-4ee5-97a1-2ade68289b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40535e5-b77e-4ee5-97a1-2ade68289b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa62e11-7bd7-454f-ba04-a350e492a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa62e11-7bd7-454f-ba04-a350e492a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8b8664-a205-432e-9c6c-fb17faefd1d6', 'volume_name': 'volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de102b1-eeba-4355-943d-74948b4d7d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de102b1-eeba-4355-943d-74948b4d7d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a937329-a49a-4727-bfce-aad24a9acc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume ca8b8664-a205-432e-9c6c-fb17faefd1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6', 'volume_size': 1} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062579186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8b8664-a205-432e-9c6c-fb17faefd1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:21Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Creating volume ca8b8664-a205-432e-9c6c-fb17faefd1d6 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:21 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 1073741824 Nov 06 21:36:21 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:21 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc" returned: 0 in 0.454s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc Nov 06 21:36:21 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:21 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b5f17327-ed03-4a33-b2d2-573e40ac58cc" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-b5f17327-ed03-4a33-b2d2-573e40ac58cc" released by "delete_volume" :: held 0.918s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Flow 'volume_create_manager' (59b2698e-672a-4ada-b7ea-26bc42689d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:21 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be82933-644e-4000-904b-a0452d98b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 1073741824" returned: 0 in 0.596s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be82933-644e-4000-904b-a0452d98b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-212613379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777bdb5b-fad9-4eaa-b505-9b4667a8576a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a4f0167bd94955993330d886b17b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:22Z,use_quota=True,user_id='6aa46584c2ed402ea3e42b7962ae5e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2c8fe1-21d0-4dbf-9f38-0183dab3dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2c8fe1-21d0-4dbf-9f38-0183dab3dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99127055-255c-4ad6-925b-c6044e44426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99127055-255c-4ad6-925b-c6044e44426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777bdb5b-fad9-4eaa-b505-9b4667a8576a', 'volume_name': 'volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f02eb6-5fae-4e08-8dd1-26d4b01391b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f02eb6-5fae-4e08-8dd1-26d4b01391b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd61ddb1-cccb-43b8-b7e2-c128c926b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Volume 777bdb5b-fad9-4eaa-b505-9b4667a8576a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a', 'volume_size': 1} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 Nov 06 21:36:21 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Created reservations ['5f064799-1de0-4483-b529-1e0642dc6b83', '76d7d440-f577-40fe-b03a-76f6717e596e', 'd727060d-2f5b-4660-97b6-fcff8b86162f', '13831a12-daa4-4756-a180-644cf2fee411'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:21 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (95ce4f65-ef75-4f61-be7d-281723616851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7b8597-83ee-40fb-9b16-357c6397d369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7b8597-83ee-40fb-9b16-357c6397d369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236067810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4978a6a5-4f95-41ae-bb81-1dfb329cffad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:22Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c984ab22-e880-4773-b071-2cc00a00aa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c984ab22-e880-4773-b071-2cc00a00aa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a25877d-e50f-4dee-9d77-14e43e62890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a25877d-e50f-4dee-9d77-14e43e62890c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4978a6a5-4f95-41ae-bb81-1dfb329cffad', 'volume_name': 'volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:22 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a20296e-aa5c-4b84-a335-0f593ccd9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a20296e-aa5c-4b84-a335-0f593ccd9086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6599682b-9cf9-4105-8420-3349cc41d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume 4978a6a5-4f95-41ae-bb81-1dfb329cffad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad', 'volume_size': 1} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6" returned: 0 in 0.355s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-212613379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777bdb5b-fad9-4eaa-b505-9b4667a8576a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a4f0167bd94955993330d886b17b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:22Z,use_quota=True,user_id='6aa46584c2ed402ea3e42b7962ae5e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Creating volume 777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:22 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a 1073741824 Nov 06 21:36:22 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a937329-a49a-4727-bfce-aad24a9acc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a8eef-5ecb-4e76-955a-718e421fb565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 (ca8b8664-a205-432e-9c6c-fb17faefd1d6): created successfully Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a8eef-5ecb-4e76-955a-718e421fb565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (664a5fcd-2e2d-496b-b7ba-2d9a359bab30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-60d30843-9028-4ba1-b692-c02c998751a3 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created volume successfully. Nov 06 21:36:22 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Deleted volume successfully. Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e0547f19-5fe6-4cd4-8d4b-291d57b995ef tempest-VolumeDependencyTests-245884239 None] Lock "cinder-b5f17327-ed03-4a33-b2d2-573e40ac58cc-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:22 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a 1073741824" returned: 0 in 0.456s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a Nov 06 21:36:22 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a" returned: 0 in 0.271s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236067810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4978a6a5-4f95-41ae-bb81-1dfb329cffad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:22Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Creating volume 4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:22 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-88ccd7bf-458b-4715-9429-a0d276ee4087-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:22 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad 1073741824 Nov 06 21:36:22 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd61ddb1-cccb-43b8-b7e2-c128c926b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aec141-c85f-48a3-88a7-8535e2ea2818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-88ccd7bf-458b-4715-9429-a0d276ee4087-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Volume volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a (777bdb5b-fad9-4eaa-b505-9b4667a8576a): created successfully Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aec141-c85f-48a3-88a7-8535e2ea2818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Flow 'volume_create_manager' (59b2698e-672a-4ada-b7ea-26bc42689d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:23 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3ed9e607-66b3-4c2a-a856-d77e550965e5 tempest-CinderUnicodeTest-2098448608 None] Created volume successfully. Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Acquiring lock "cinder-quobyte-88ccd7bf-458b-4715-9429-a0d276ee4087" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-88ccd7bf-458b-4715-9429-a0d276ee4087" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ced9ea-9420-45f0-9145-0aa639ac39ec]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:23 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 Nov 06 21:36:23 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad 1073741824" returned: 0 in 0.587s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:23 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087" returned: 0 in 0.496s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:23 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad Nov 06 21:36:23 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087 Nov 06 21:36:23 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (eaa39625-2854-4a8d-baff-909e3f90b3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23f3ab0-92bd-4abb-8da6-34ab5f9b66a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23f3ab0-92bd-4abb-8da6-34ab5f9b66a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475689272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecceea3-8c92-43fe-a94b-42096c37b34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:24Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bf5155-8cdc-4d19-bafa-f8d74c06b7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bf5155-8cdc-4d19-bafa-f8d74c06b7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04d3638-cba2-4a52-bc8f-918d98c4d11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04d3638-cba2-4a52-bc8f-918d98c4d11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aecceea3-8c92-43fe-a94b-42096c37b34a', 'volume_name': 'volume-aecceea3-8c92-43fe-a94b-42096c37b34a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49495169-7638-4130-9b77-aaf006cd9425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49495169-7638-4130-9b77-aaf006cd9425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49599c8-594f-4984-b40c-9055f2df02eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:23 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume aecceea3-8c92-43fe-a94b-42096c37b34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aecceea3-8c92-43fe-a94b-42096c37b34a', 'volume_size': 1} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:23 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad" returned: 0 in 0.393s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475689272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecceea3-8c92-43fe-a94b-42096c37b34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:24Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Creating volume aecceea3-8c92-43fe-a94b-42096c37b34a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:23 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6599682b-9cf9-4105-8420-3349cc41d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d2c41a-561c-4fd6-94a2-bc055b1d3bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a 1073741824 Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-88ccd7bf-458b-4715-9429-a0d276ee4087" returned: 0 in 0.427s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:24 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad (4978a6a5-4f95-41ae-bb81-1dfb329cffad): created successfully Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d2c41a-561c-4fd6-94a2-bc055b1d3bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (95ce4f65-ef75-4f61-be7d-281723616851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-quobyte-88ccd7bf-458b-4715-9429-a0d276ee4087" released by "delete_volume" :: held 1.002s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4d3f9b8c-399e-49d0-a93c-d78e92c8c080 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created volume successfully. Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Created reservations ['63653ed4-9b69-4783-9a36-cd58c2514617', '2a404545-1a1e-48c7-938d-70743e18e12e', '79931714-0ecd-4da9-b702-1c2af0bf0284', 'd3cdb6c9-6f5e-4186-8df8-c6ca53105dec'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:24 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (d3209bb5-f133-4a7d-8cd3-8c81fc83c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ac4ddb-e895-4256-ae76-4dfd8e29e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ac4ddb-e895-4256-ae76-4dfd8e29e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025082086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bdddf9-73e0-4e3b-a990-6c94d61e2569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:24Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3051087-aa6e-4d49-ba1f-b850f4afdfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3051087-aa6e-4d49-ba1f-b850f4afdfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb823cd4-e784-440c-92ad-e89cb9a4d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb823cd4-e784-440c-92ad-e89cb9a4d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4bdddf9-73e0-4e3b-a990-6c94d61e2569', 'volume_name': 'volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c333239b-db64-4435-99e1-74c003dfb73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c333239b-db64-4435-99e1-74c003dfb73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac35a8e7-ab70-468e-b551-b01a4065ad66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume e4bdddf9-73e0-4e3b-a990-6c94d61e2569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569', 'volume_size': 1} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:24 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.416s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Deleted volume successfully. Nov 06 21:36:24 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a 1073741824" returned: 0 in 0.759s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bb7931ce-88e2-4b1f-a494-a24ebf9060b3 tempest-VolumeDependencyTests-245884239 None] Lock "cinder-88ccd7bf-458b-4715-9429-a0d276ee4087-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:24 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a Nov 06 21:36:24 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (508f703a-a16f-4d8b-9fe5-93c906305399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0867cc34-b4f3-4883-9484-383089796e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0867cc34-b4f3-4883-9484-383089796e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923215909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28d57ed-3a7e-4d35-9d87-331173c2ef5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:25Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24e20f7-14c7-4c95-a2f8-f7392276e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24e20f7-14c7-4c95-a2f8-f7392276e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602822d2-5eda-4c9a-b836-4575a81cf452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602822d2-5eda-4c9a-b836-4575a81cf452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28d57ed-3a7e-4d35-9d87-331173c2ef5a', 'volume_name': 'volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c463413-d923-47a2-9f89-0d8be904f35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c463413-d923-47a2-9f89-0d8be904f35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a5d17e-1012-4aca-8e53-4100c6690b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume a28d57ed-3a7e-4d35-9d87-331173c2ef5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a', 'volume_size': 1} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:25 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a" returned: 0 in 0.333s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.755s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49599c8-594f-4984-b40c-9055f2df02eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecceea3-8c92-43fe-a94b-42096c37b34a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab2ab8-b84a-4ef9-82c3-a52a3e802411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Creating offline snapshot 27bfb415-d5d4-4d17-beb5-5ce944aa892b of volume 777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume volume-aecceea3-8c92-43fe-a94b-42096c37b34a (aecceea3-8c92-43fe-a94b-42096c37b34a): created successfully Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab2ab8-b84a-4ef9-82c3-a52a3e802411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (eaa39625-2854-4a8d-baff-909e3f90b3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f473f4-c8aa-46a5-b140-d9d66e936a09]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6f3b5404-168d-4b5c-8612-9139a890bf12 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created volume successfully. Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:25 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a Nov 06 21:36:25 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (accdad7c-aaf5-4b1f-a45f-453f94a8217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1721e6a4-ea33-4894-abaa-792603bc3daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1721e6a4-ea33-4894-abaa-792603bc3daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165323597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e60deb6-6699-4b0d-8023-2efbaba25769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:25Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804527a5-55c7-4b09-921e-83937da106eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804527a5-55c7-4b09-921e-83937da106eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e849ad-de22-43c0-a135-b8a5825b9865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e849ad-de22-43c0-a135-b8a5825b9865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e60deb6-6699-4b0d-8023-2efbaba25769', 'volume_name': 'volume-9e60deb6-6699-4b0d-8023-2efbaba25769', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5089709-1c6f-4b09-ba6b-fc68b72d3352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5089709-1c6f-4b09-ba6b-fc68b72d3352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae6cfbf-9e5c-4852-b394-f6ac899a6c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume 9e60deb6-6699-4b0d-8023-2efbaba25769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e60deb6-6699-4b0d-8023-2efbaba25769', 'volume_size': 1} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:25 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a" returned: 0 in 0.545s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:25 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b 1G Nov 06 21:36:25 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (64ca203b-d280-4376-8eea-187f885254f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298fc425-595d-4b25-b183-5fe83b24ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298fc425-595d-4b25-b183-5fe83b24ca90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446667609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64e3bed-d7d1-472b-b681-8830cdf48002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:26Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714c150f-69dd-49f0-9812-815d1b538128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714c150f-69dd-49f0-9812-815d1b538128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99577d1-1b05-4246-90f6-75d067837746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99577d1-1b05-4246-90f6-75d067837746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64e3bed-d7d1-472b-b681-8830cdf48002', 'volume_name': 'volume-c64e3bed-d7d1-472b-b681-8830cdf48002', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96cd40-1b12-4bdf-9c18-c02c9c41bf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96cd40-1b12-4bdf-9c18-c02c9c41bf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3eae25-5a92-4957-84e9-0a9eb6a0fd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume c64e3bed-d7d1-472b-b681-8830cdf48002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64e3bed-d7d1-472b-b681-8830cdf48002', 'volume_size': 1} Nov 06 21:36:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:26 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b 1G" returned: 0 in 0.464s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:26 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b Nov 06 21:36:26 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:26 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b" returned: 0 in 0.342s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:26 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b is being set with open permissions: ugo+rw Nov 06 21:36:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:26 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b Nov 06 21:36:26 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:26 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b" returned: 0 in 0.279s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:26 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.info Nov 06 21:36:26 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:27 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.info" returned: 0 in 0.276s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:27 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.info is being set with open permissions: ugo+rw Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:27 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.info Nov 06 21:36:27 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:27 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.info" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025082086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bdddf9-73e0-4e3b-a990-6c94d61e2569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:24Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Creating volume e4bdddf9-73e0-4e3b-a990-6c94d61e2569 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:27 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:27 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 1073741824 Nov 06 21:36:27 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-cef705b0-475d-484e-8a4a-7534c25e345a tempest-CinderUnicodeTest-2098448608 None] Create snapshot completed successfully Nov 06 21:36:28 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 1073741824" returned: 0 in 0.522s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 Nov 06 21:36:28 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569" returned: 0 in 0.257s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.533s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac35a8e7-ab70-468e-b551-b01a4065ad66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361288f6-fd6a-4724-a5f0-0a367afbfc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Creating offline snapshot 8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 of volume 4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 (e4bdddf9-73e0-4e3b-a990-6c94d61e2569): created successfully Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361288f6-fd6a-4724-a5f0-0a367afbfc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (d3209bb5-f133-4a7d-8cd3-8c81fc83c46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[24475aea-5ab3-4813-b0d5-7537a7143f8a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-11759a08-6809-4249-9b52-39ce7a2bc93b tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created volume successfully. Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "cinder-27bfb415-d5d4-4d17-beb5-5ce944aa892b-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fb9efdff-82cb-4b5b-a064-f8916a13783d tempest-ProjectAdminTests-1874168780 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87450) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-27bfb415-d5d4-4d17-beb5-5ce944aa892b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "cinder-quobyte-777bdb5b-fad9-4eaa-b505-9b4667a8576a" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:28 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad Nov 06 21:36:28 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-777bdb5b-fad9-4eaa-b505-9b4667a8576a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "cinder-quobyte-27bfb415-d5d4-4d17-beb5-5ce944aa892b" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-27bfb415-d5d4-4d17-beb5-5ce944aa892b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Deleting offline snapshot 27bfb415-d5d4-4d17-beb5-5ce944aa892b of volume 777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] snapshot_file for this snap is: volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac2d71-f7b7-4857-a434-6cc5d046a583]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b Nov 06 21:36:28 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad" returned: 0 in 0.486s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 1G Nov 06 21:36:28 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:29 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b" returned: 0 in 0.449s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a23102-25c5-46b1-b4ab-7941f3006981]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a Nov 06 21:36:29 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:29 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 1G" returned: 0 in 0.524s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 Nov 06 21:36:29 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:29 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a" returned: 0 in 0.434s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b Nov 06 21:36:29 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:29 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" returned: 0 in 0.341s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:29 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 is being set with open permissions: ugo+rw Nov 06 21:36:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 Nov 06 21:36:29 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b" returned: 0 in 0.412s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:30 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b Nov 06 21:36:30 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" returned: 0 in 0.303s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:30 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.info Nov 06 21:36:30 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a.27bfb415-d5d4-4d17-beb5-5ce944aa892b" returned: 0 in 0.296s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-27bfb415-d5d4-4d17-beb5-5ce944aa892b" released by "_delete_snapshot" :: held 1.742s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-777bdb5b-fad9-4eaa-b505-9b4667a8576a" released by "delete_snapshot" :: held 1.769s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:30 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.info" returned: 0 in 0.283s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.info is being set with open permissions: ugo+rw Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:30 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.info Nov 06 21:36:30 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Created reservations ['9e71d8c1-b1f8-4b78-837b-3729f4fd5b0f', '89a39959-4b4b-4951-9a93-bb11bc7c30f0', '98687fbc-0b2f-4715-97e8-90e662c3bf75', 'c2557e99-2e25-4e29-8fba-0bc39f2d68e4'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Delete snapshot completed successfully. Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3a20c89c-f352-4f29-8287-9ced81d79b9e tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-27bfb415-d5d4-4d17-beb5-5ce944aa892b-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:30 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.info" returned: 0 in 0.287s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.707s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923215909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28d57ed-3a7e-4d35-9d87-331173c2ef5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:25Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Creating volume a28d57ed-3a7e-4d35-9d87-331173c2ef5a {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:30 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "cinder-777bdb5b-fad9-4eaa-b505-9b4667a8576a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:30 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a 1073741824 Nov 06 21:36:30 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-777bdb5b-fad9-4eaa-b505-9b4667a8576a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-349c7666-2e4e-4243-bbae-323365800094 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Create snapshot completed successfully Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "cinder-quobyte-777bdb5b-fad9-4eaa-b505-9b4667a8576a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-777bdb5b-fad9-4eaa-b505-9b4667a8576a" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[44462f64-e789-499b-92a3-4d8fe588abb1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:31 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a Nov 06 21:36:31 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:31 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a 1073741824" returned: 0 in 0.632s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:31 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a" returned: 0 in 0.510s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:31 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a Nov 06 21:36:31 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:31 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a Nov 06 21:36:31 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (cda9df20-ed46-4ddd-ae05-b80229ba1d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6300004a-d14c-40f7-8351-3032e2d96b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6300004a-d14c-40f7-8351-3032e2d96b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70279747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db35270-805a-492b-ad03-88d74b0b6949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:32Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c7634b-84c8-4133-aa07-034c59c73233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c7634b-84c8-4133-aa07-034c59c73233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f710d-7cb0-4196-9fe9-cff88376664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f710d-7cb0-4196-9fe9-cff88376664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db35270-805a-492b-ad03-88d74b0b6949', 'volume_name': 'volume-9db35270-805a-492b-ad03-88d74b0b6949', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b211131-de73-4c68-9217-b1f8e13638e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b211131-de73-4c68-9217-b1f8e13638e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714a5988-9dac-4bca-b0b2-66357acba810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:31 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume 9db35270-805a-492b-ad03-88d74b0b6949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db35270-805a-492b-ad03-88d74b0b6949', 'volume_size': 1} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:31 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-777bdb5b-fad9-4eaa-b505-9b4667a8576a" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-777bdb5b-fad9-4eaa-b505-9b4667a8576a" released by "delete_volume" :: held 1.099s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:32 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a" returned: 0 in 0.531s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.455s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165323597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e60deb6-6699-4b0d-8023-2efbaba25769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:25Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Creating volume 9e60deb6-6699-4b0d-8023-2efbaba25769 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:32 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 1073741824 Nov 06 21:36:32 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a5d17e-1012-4aca-8e53-4100c6690b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ef54cf-9e25-4b16-95b6-6a31e5d9e9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a (a28d57ed-3a7e-4d35-9d87-331173c2ef5a): created successfully Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ef54cf-9e25-4b16-95b6-6a31e5d9e9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (508f703a-a16f-4d8b-9fe5-93c906305399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Created reservations ['ad604de3-ba14-450e-af28-38c53f5f46c6', '393903a7-4476-49df-a4ab-7e26a95f6146', '3be4b95a-5ab8-4f66-9b85-70640e03e59c', '0fc499d0-9094-4f49-ad8f-5b856df7b014'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-7b65eec2-7c16-472c-880f-47c71c397ab9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created volume successfully. Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (6c81eebf-982e-4f5b-8ed9-eb92a849a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc507e6-fac0-42b4-9820-937edaca8037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc507e6-fac0-42b4-9820-937edaca8037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122768619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe5d0b4-68c9-4e92-994b-11030df13f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:32Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512ac96d-12fa-41fd-9e45-6e493af2da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512ac96d-12fa-41fd-9e45-6e493af2da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971523c9-d7a7-4bc4-aece-7a90cfad0f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971523c9-d7a7-4bc4-aece-7a90cfad0f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe5d0b4-68c9-4e92-994b-11030df13f0d', 'volume_name': 'volume-afe5d0b4-68c9-4e92-994b-11030df13f0d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a69fb29-29d9-4545-95f6-9054cbfd3ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a69fb29-29d9-4545-95f6-9054cbfd3ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d685c5-6aa5-4cf1-bac6-00b427db2883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume afe5d0b4-68c9-4e92-994b-11030df13f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe5d0b4-68c9-4e92-994b-11030df13f0d', 'volume_size': 1} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:32 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (4d6c3392-32b5-469b-8f2e-dafe1596a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30be4d6-1acb-4441-9f55-aee79e1e0b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30be4d6-1acb-4441-9f55-aee79e1e0b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758032356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77499feb-d922-42d4-bb07-1d57c03ee370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:33Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f5edea-ccc6-4e5e-af57-780496ec17a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f5edea-ccc6-4e5e-af57-780496ec17a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc746644-57fa-471c-8c1d-31c50764bb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc746644-57fa-471c-8c1d-31c50764bb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77499feb-d922-42d4-bb07-1d57c03ee370', 'volume_name': 'volume-77499feb-d922-42d4-bb07-1d57c03ee370', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185eb705-30f4-454d-841e-451dd706cde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185eb705-30f4-454d-841e-451dd706cde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad5bd34-9c30-470a-a14d-cfb801516180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume 77499feb-d922-42d4-bb07-1d57c03ee370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77499feb-d922-42d4-bb07-1d57c03ee370', 'volume_size': 1} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:32 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.399s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Deleted volume successfully. Nov 06 21:36:32 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 1073741824" returned: 0 in 0.813s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4eb70df7-1db9-47ff-a1a0-8e1a044ca925 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-777bdb5b-fad9-4eaa-b505-9b4667a8576a-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 Nov 06 21:36:32 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (ee601ed8-5fee-4005-935d-ec297ea4eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8759719-c1f3-40cd-8d32-0f7489e14a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "cinder-770510c6-144e-4220-a790-c49cf16fa3db-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8759719-c1f3-40cd-8d32-0f7489e14a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1914944333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b28371-981c-4976-8776-eadd340d34b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:33Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b552d1-88e1-4226-be96-5535e39732bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b552d1-88e1-4226-be96-5535e39732bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513db2b-8e12-4a97-9d4c-a2984b570e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513db2b-8e12-4a97-9d4c-a2984b570e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b28371-981c-4976-8776-eadd340d34b4', 'volume_name': 'volume-e2b28371-981c-4976-8776-eadd340d34b4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dffe964-aba9-447a-9586-7ed8a3716ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dffe964-aba9-447a-9586-7ed8a3716ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc5a4d0-cb3d-4ac4-b60b-c1c690b7557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume e2b28371-981c-4976-8776-eadd340d34b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b28371-981c-4976-8776-eadd340d34b4', 'volume_size': 1} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-770510c6-144e-4220-a790-c49cf16fa3db-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769" returned: 0 in 0.369s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.313s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446667609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64e3bed-d7d1-472b-b681-8830cdf48002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bfe7bed214fc9a4a20fbde7b891a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:26Z,use_quota=True,user_id='0fddb62c198b4e90b118d209cc5b6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Creating volume c64e3bed-d7d1-472b-b681-8830cdf48002 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:33 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae6cfbf-9e5c-4852-b394-f6ac899a6c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e60deb6-6699-4b0d-8023-2efbaba25769', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 1073741824 Nov 06 21:36:33 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07c3877-65ac-4b86-9eda-c8a68957b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume volume-9e60deb6-6699-4b0d-8023-2efbaba25769 (9e60deb6-6699-4b0d-8023-2efbaba25769): created successfully Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07c3877-65ac-4b86-9eda-c8a68957b12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (accdad7c-aaf5-4b1f-a45f-453f94a8217c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "cinder-quobyte-770510c6-144e-4220-a790-c49cf16fa3db" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b41dbb38-45f7-4671-aadc-759572d0696f tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created volume successfully. Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-770510c6-144e-4220-a790-c49cf16fa3db" acquired by "delete_volume" :: waited 0.052s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a0b568-1586-4b3e-860c-0b0370837dae]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (d65d9169-4ea5-40d4-b7c8-fca43b39870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2055ad78-30b4-428a-bbb5-1ea3e7c81f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2055ad78-30b4-428a-bbb5-1ea3e7c81f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398312288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8fdc22e-f781-46bf-918a-7b81cb0c4909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:34Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db Nov 06 21:36:33 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f49f31-efb1-4a90-88ca-aeba1ea4d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f49f31-efb1-4a90-88ca-aeba1ea4d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7a06d-46e5-484d-887a-735da14915d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7a06d-46e5-484d-887a-735da14915d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8fdc22e-f781-46bf-918a-7b81cb0c4909', 'volume_name': 'volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cc793a-f9d5-495c-a991-50afa3d90772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cc793a-f9d5-495c-a991-50afa3d90772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fd0d39-2981-4705-8a37-6bf7f5a54514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume d8fdc22e-f781-46bf-918a-7b81cb0c4909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909', 'volume_size': 1} Nov 06 21:36:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:34 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db" returned: 0 in 0.464s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 1073741824" returned: 0 in 0.737s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db Nov 06 21:36:34 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Flow 'volume_create_manager' (942a3c50-7046-4710-ae19-d52a56814709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300c0bc7-a8d9-464d-8a93-d5d9853fb7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300c0bc7-a8d9-464d-8a93-d5d9853fb7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658055512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0277fed9-49d1-4cd8-96ab-d1b264dffb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ce3d3bffd1472193913851c4e11fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:34Z,use_quota=True,user_id='ba716faf017744dab0dcd543bded1e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:34 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 Nov 06 21:36:34 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3bb58b-5454-4b83-999f-70b3484e669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3bb58b-5454-4b83-999f-70b3484e669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9432c52e-ed4e-4252-ac9d-c2cfb7786db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9432c52e-ed4e-4252-ac9d-c2cfb7786db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0277fed9-49d1-4cd8-96ab-d1b264dffb72', 'volume_name': 'volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dce108e-672a-46b2-b35d-10ce73047e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dce108e-672a-46b2-b35d-10ce73047e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f500a60-8e17-4f44-9fe1-d54a6cb2776f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Volume 0277fed9-49d1-4cd8-96ab-d1b264dffb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72', 'volume_size': 1} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:34 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770510c6-144e-4220-a790-c49cf16fa3db" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-quobyte-770510c6-144e-4220-a790-c49cf16fa3db" released by "delete_volume" :: held 0.828s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Created reservations ['925dd8ec-3b50-44a1-acf7-5c47793d33d9', '4cc3332e-f556-4841-b09b-6a6993d9eb98', 'ff4dedbd-c72b-4ac2-95d2-8c39bdfa7dcc', 'ae109c0b-e8c1-4ce5-9e6e-9f3e3f732d7d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:34 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002" returned: 0 in 0.247s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70279747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db35270-805a-492b-ad03-88d74b0b6949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:32Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Creating volume 9db35270-805a-492b-ad03-88d74b0b6949 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:34 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3eae25-5a92-4957-84e9-0a9eb6a0fd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64e3bed-d7d1-472b-b681-8830cdf48002', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:34 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 1073741824 Nov 06 21:36:34 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da13d137-0566-4b89-8556-d556acede5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:34 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Volume volume-c64e3bed-d7d1-472b-b681-8830cdf48002 (c64e3bed-d7d1-472b-b681-8830cdf48002): created successfully Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da13d137-0566-4b89-8556-d556acede5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Flow 'volume_create_manager' (64ca203b-d280-4376-8eea-187f885254f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fc8a0213-ba73-4f02-a3e8-74fd9d89c6f5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created volume successfully. Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:34 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.348s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:34 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Deleted volume successfully. Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-c64e3bed-d7d1-472b-b681-8830cdf48002-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-c64e3bed-d7d1-472b-b681-8830cdf48002-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d785c91c-a25e-4178-93cb-c1effae80b53 tempest-CinderUnicodeTest-2098448608 None] Lock "cinder-770510c6-144e-4220-a790-c49cf16fa3db-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:34 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 1073741824" returned: 0 in 0.565s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-quobyte-c64e3bed-d7d1-472b-b681-8830cdf48002" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-c64e3bed-d7d1-472b-b681-8830cdf48002" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cb091a-2423-4296-9f2f-5542fcc89712]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 Nov 06 21:36:35 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 Nov 06 21:36:35 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949" returned: 0 in 0.267s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.972s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122768619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe5d0b4-68c9-4e92-994b-11030df13f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:32Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Creating volume afe5d0b4-68c9-4e92-994b-11030df13f0d {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:35 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714a5988-9dac-4bca-b0b2-66357acba810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db35270-805a-492b-ad03-88d74b0b6949', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6557ba-64b1-4500-8827-f2a14b70d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:35 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d 1073741824 Nov 06 21:36:35 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume volume-9db35270-805a-492b-ad03-88d74b0b6949 (9db35270-805a-492b-ad03-88d74b0b6949): created successfully Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6557ba-64b1-4500-8827-f2a14b70d796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (cda9df20-ed46-4ddd-ae05-b80229ba1d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bf89feba-adbb-42a7-ab64-18d648050e0b tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created volume successfully. Nov 06 21:36:35 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002" returned: 0 in 0.472s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002 Nov 06 21:36:35 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c64e3bed-d7d1-472b-b681-8830cdf48002" returned: 0 in 0.361s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-c64e3bed-d7d1-472b-b681-8830cdf48002" released by "delete_volume" :: held 0.884s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created reservations ['25d79b06-6120-4ec4-ae46-e7670f0ef5f1', 'a4a60f45-27b7-4c0d-8f32-a166fd06e7ad', '92d970fd-0a02-4481-ad30-26f83646d9ef', '9412e77f-acb8-4077-a876-12f806988e87'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:35 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d 1073741824" returned: 0 in 0.678s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d Nov 06 21:36:36 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:36 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-9e60deb6-6699-4b0d-8023-2efbaba25769-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-9e60deb6-6699-4b0d-8023-2efbaba25769-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-quobyte-9e60deb6-6699-4b0d-8023-2efbaba25769" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-9e60deb6-6699-4b0d-8023-2efbaba25769" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:36 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c5a8e1-2b57-41e4-810f-27cfb6bccee6]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d" returned: 0 in 0.370s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.627s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758032356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77499feb-d922-42d4-bb07-1d57c03ee370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:33Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Creating volume 77499feb-d922-42d4-bb07-1d57c03ee370 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:36 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:36 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.379s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:36 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 1073741824 Nov 06 21:36:36 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d685c5-6aa5-4cf1-bac6-00b427db2883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe5d0b4-68c9-4e92-994b-11030df13f0d', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4043db33-dff3-445d-aa37-a92033e0e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Deleted volume successfully. Nov 06 21:36:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume volume-afe5d0b4-68c9-4e92-994b-11030df13f0d (afe5d0b4-68c9-4e92-994b-11030df13f0d): created successfully Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4043db33-dff3-445d-aa37-a92033e0e45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (6c81eebf-982e-4f5b-8ed9-eb92a849a416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-286d12bb-45b2-4f69-aa5e-0f89ddcc2ed9 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-c64e3bed-d7d1-472b-b681-8830cdf48002-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fc3b1bfa-d8bb-4c5e-8d31-c7f4a755bca6 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created volume successfully. Nov 06 21:36:36 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 Nov 06 21:36:36 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769" returned: 0 in 0.480s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769 Nov 06 21:36:36 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 1073741824" returned: 0 in 0.559s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 Nov 06 21:36:37 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9e60deb6-6699-4b0d-8023-2efbaba25769" returned: 0 in 0.293s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-9e60deb6-6699-4b0d-8023-2efbaba25769" released by "delete_volume" :: held 0.852s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created reservations ['2d9efc49-ea9f-44da-88aa-d0c7ef4b9004', 'c59eb134-e87e-427e-87be-f4aa7b82c047', 'eb6cf8d3-7ff2-4107-b560-f46a725b6078', '3990266d-b428-498e-be3b-0d3f4869c264'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:37 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370" returned: 0 in 0.351s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.153s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1914944333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b28371-981c-4976-8776-eadd340d34b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:33Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Creating volume e2b28371-981c-4976-8776-eadd340d34b4 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:37 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:37 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:37 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad5bd34-9c30-470a-a14d-cfb801516180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77499feb-d922-42d4-bb07-1d57c03ee370', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def4aec3-0b61-4465-bde4-0c18e1d08bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:37 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 1073741824 Nov 06 21:36:37 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume volume-77499feb-d922-42d4-bb07-1d57c03ee370 (77499feb-d922-42d4-bb07-1d57c03ee370): created successfully Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def4aec3-0b61-4465-bde4-0c18e1d08bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (4d6c3392-32b5-469b-8f2e-dafe1596a226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e5ee4f2e-16a8-41e7-add3-11bf73024013 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created volume successfully. Nov 06 21:36:37 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.280s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Deleted volume successfully. Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9bcde05d-3209-4ef7-859a-fd39c55c8f63 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-9e60deb6-6699-4b0d-8023-2efbaba25769-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:37 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 1073741824" returned: 0 in 0.527s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 Nov 06 21:36:38 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.500s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398312288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8fdc22e-f781-46bf-918a-7b81cb0c4909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b09f17d5d2c4f85a1d306bcc5a50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:34Z,use_quota=True,user_id='ea5a0d34c75e4f2ea5a19dfc1219f0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Creating volume d8fdc22e-f781-46bf-918a-7b81cb0c4909 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:38 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc5a4d0-cb3d-4ac4-b60b-c1c690b7557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b28371-981c-4976-8776-eadd340d34b4', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 1073741824 Nov 06 21:36:38 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad00d088-27c6-466f-88db-8efb2630ced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume volume-e2b28371-981c-4976-8776-eadd340d34b4 (e2b28371-981c-4976-8776-eadd340d34b4): created successfully Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad00d088-27c6-466f-88db-8efb2630ced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (ee601ed8-5fee-4005-935d-ec297ea4eab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1df7d11b-e8d5-4806-b828-8910194d50fc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created volume successfully. Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-a28d57ed-3a7e-4d35-9d87-331173c2ef5a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-a28d57ed-3a7e-4d35-9d87-331173c2ef5a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-quobyte-a28d57ed-3a7e-4d35-9d87-331173c2ef5a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-a28d57ed-3a7e-4d35-9d87-331173c2ef5a" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[46522920-31b5-49b7-9a2c-798f2dfebb1c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a Nov 06 21:36:38 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 1073741824" returned: 0 in 0.540s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 Nov 06 21:36:38 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a" returned: 0 in 0.415s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a Nov 06 21:36:39 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909" returned: 0 in 0.291s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.999s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658055512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0277fed9-49d1-4cd8-96ab-d1b264dffb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ce3d3bffd1472193913851c4e11fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:34Z,use_quota=True,user_id='ba716faf017744dab0dcd543bded1e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Creating volume 0277fed9-49d1-4cd8-96ab-d1b264dffb72 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:39 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fd0d39-2981-4705-8a37-6bf7f5a54514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdf156e-a574-41ca-bea8-376ef2d06607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:39 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 1073741824 Nov 06 21:36:39 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Volume volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 (d8fdc22e-f781-46bf-918a-7b81cb0c4909): created successfully Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdf156e-a574-41ca-bea8-376ef2d06607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Flow 'volume_create_manager' (d65d9169-4ea5-40d4-b7c8-fca43b39870c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:39 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-061230bd-d9a0-48d9-993f-29f99ec4de5a tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created volume successfully. Nov 06 21:36:39 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a28d57ed-3a7e-4d35-9d87-331173c2ef5a" returned: 0 in 0.335s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-a28d57ed-3a7e-4d35-9d87-331173c2ef5a" released by "delete_volume" :: held 0.801s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created reservations ['859d9c93-eb07-455d-ad1c-b6c7afb67a31', 'a1a660e5-5e12-4f19-9b2d-1d9ce9c8c23f', '5fb919b1-803b-4c22-8d49-85005e3156fc', '84de98b5-677c-4007-87e3-8d701ba510db'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:39 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-e4bdddf9-73e0-4e3b-a990-6c94d61e2569-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-e4bdddf9-73e0-4e3b-a990-6c94d61e2569-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:39 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-quobyte-e4bdddf9-73e0-4e3b-a990-6c94d61e2569" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 1073741824" returned: 0 in 0.611s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-e4bdddf9-73e0-4e3b-a990-6c94d61e2569" acquired by "delete_volume" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc95c7d-6957-4fc0-b3d4-f63ff01d6ebc]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:39 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:39 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Deleted volume successfully. Nov 06 21:36:39 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 Nov 06 21:36:39 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-337c51b7-701b-475e-9a00-347fcf5247fd tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-a28d57ed-3a7e-4d35-9d87-331173c2ef5a-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:39 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 Nov 06 21:36:39 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72" returned: 0 in 0.281s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f500a60-8e17-4f44-9fe1-d54a6cb2776f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b3d158-9665-4190-9779-78b3d05bc19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Volume volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 (0277fed9-49d1-4cd8-96ab-d1b264dffb72): created successfully Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b3d158-9665-4190-9779-78b3d05bc19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Flow 'volume_create_manager' (942a3c50-7046-4710-ae19-d52a56814709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9901d844-8cf2-49fc-a1e6-0872ba524cf5 tempest-ProjectReaderTests-1834810983 None] Created volume successfully. Nov 06 21:36:40 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569" returned: 0 in 0.412s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569 Nov 06 21:36:40 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-d8fdc22e-f781-46bf-918a-7b81cb0c4909-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-d8fdc22e-f781-46bf-918a-7b81cb0c4909-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-d8fdc22e-f781-46bf-918a-7b81cb0c4909" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-d8fdc22e-f781-46bf-918a-7b81cb0c4909" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a5a19a-8156-418d-9cc2-65835ab32b4f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e4bdddf9-73e0-4e3b-a990-6c94d61e2569" returned: 0 in 0.371s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-e4bdddf9-73e0-4e3b-a990-6c94d61e2569" released by "delete_volume" :: held 0.842s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:40 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 Nov 06 21:36:40 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created reservations ['29a33159-7039-4063-ab1b-62f6e72ad99a', '92a2e1e1-0f9f-415d-a40e-fa2be1e0bbed', '448646e0-c204-4075-8295-9905552d28be', '9ae29603-51dc-4c4f-be73-cc586c686710'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Acquiring lock "cinder-0277fed9-49d1-4cd8-96ab-d1b264dffb72-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Lock "cinder-0277fed9-49d1-4cd8-96ab-d1b264dffb72-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-aecceea3-8c92-43fe-a94b-42096c37b34a-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:40 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:40 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-aecceea3-8c92-43fe-a94b-42096c37b34a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Acquiring lock "cinder-quobyte-0277fed9-49d1-4cd8-96ab-d1b264dffb72" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:41 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909" returned: 0 in 0.498s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Lock "cinder-quobyte-0277fed9-49d1-4cd8-96ab-d1b264dffb72" acquired by "delete_volume" :: waited 0.057s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909 Nov 06 21:36:41 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c23a29-9b91-4aee-9560-0ac049d55056]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-quobyte-aecceea3-8c92-43fe-a94b-42096c37b34a" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-aecceea3-8c92-43fe-a94b-42096c37b34a" acquired by "delete_volume" :: waited 0.031s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[da741893-9f61-4751-b052-6cbcc5750599]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.332s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:41 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Deleted volume successfully. Nov 06 21:36:41 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 Nov 06 21:36:41 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-cf684577-87be-47df-ad85-be33331862c5 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-e4bdddf9-73e0-4e3b-a990-6c94d61e2569-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:41 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-d8fdc22e-f781-46bf-918a-7b81cb0c4909" returned: 0 in 0.337s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-d8fdc22e-f781-46bf-918a-7b81cb0c4909" released by "delete_volume" :: held 0.902s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created reservations ['ddfcc7cf-add3-4796-bfe1-a00f8a3dda87', '8166cb2e-483d-4c39-b583-3d368d9d827f', 'b7ee4cf8-7bd2-4b4a-b43b-c8b9e515090f', 'fc988985-1f64-4d0a-8d02-d9e52311a50c'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72" returned: 0 in 0.521s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-e2b28371-981c-4976-8776-eadd340d34b4-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:41 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:41 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72 Nov 06 21:36:41 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-e2b28371-981c-4976-8776-eadd340d34b4-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-e2b28371-981c-4976-8776-eadd340d34b4" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-e2b28371-981c-4976-8776-eadd340d34b4" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a" returned: 0 in 0.647s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd782da2-3830-4af8-95e3-0852b9913e90]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a Nov 06 21:36:41 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.426s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Deleted volume successfully. Nov 06 21:36:42 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-0277fed9-49d1-4cd8-96ab-d1b264dffb72" returned: 0 in 0.389s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 Nov 06 21:36:42 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-408df5d9-7500-4d17-858e-457c315894e9 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-d8fdc22e-f781-46bf-918a-7b81cb0c4909-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Lock "cinder-quobyte-0277fed9-49d1-4cd8-96ab-d1b264dffb72" released by "delete_volume" :: held 1.000s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Created reservations ['9fb40f7a-0660-4b3e-ac16-752776d2661d', '6361adc8-d838-485a-a92f-7689fe41f938', '80d4b8cc-78ab-4329-812a-f6605fea062f', 'c0bcdbde-6c4c-4647-b43f-aa50d23ef941'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:42 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-aecceea3-8c92-43fe-a94b-42096c37b34a" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-aecceea3-8c92-43fe-a94b-42096c37b34a" released by "delete_volume" :: held 1.066s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:42 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created reservations ['78d50aaf-ff3b-473d-a74b-4e783e8e3e2f', '6ebf6de2-0803-4daf-8a25-94ce5daea74d', '46f58742-e5e7-49fd-85b7-b82489a4f061', '19935a0f-0eea-4986-9ef8-f82e0b6a39fc'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:42 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4" returned: 0 in 0.533s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4 Nov 06 21:36:42 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:42 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Deleted volume successfully. Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-072b9977-ae71-4ef5-b091-61bd9928fc8b tempest-ProjectReaderTests-1834810983 None] Lock "cinder-0277fed9-49d1-4cd8-96ab-d1b264dffb72-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:42 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-e2b28371-981c-4976-8776-eadd340d34b4" returned: 0 in 0.384s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.370s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-e2b28371-981c-4976-8776-eadd340d34b4" released by "delete_volume" :: held 0.993s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Deleted volume successfully. Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-3f88aa82-8875-4789-a430-143ca2dbe674 tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-aecceea3-8c92-43fe-a94b-42096c37b34a-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created reservations ['76411224-8d92-401e-99d8-7eccd41cf6c2', '61853e6a-1de8-40c3-b394-281730104ebf', '349afeb4-a0a3-449d-be30-0ff96da75540', '7ea5f3d6-3e4c-4ae5-92a6-99394400cce0'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:42 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.272s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:43 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Deleted volume successfully. Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a1680abf-b80f-4050-8882-1a7515c421bc tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-e2b28371-981c-4976-8776-eadd340d34b4-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-ca8b8664-a205-432e-9c6c-fb17faefd1d6-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-ca8b8664-a205-432e-9c6c-fb17faefd1d6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "cinder-quobyte-ca8b8664-a205-432e-9c6c-fb17faefd1d6" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-ca8b8664-a205-432e-9c6c-fb17faefd1d6" acquired by "delete_volume" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9641ca10-41c1-4d5b-8fc2-0bab3754d503]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 Nov 06 21:36:43 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Flow 'volume_create_manager' (be152635-9630-4c2e-9a83-62595ab9cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb6f4d9-e422-473d-a1e1-c362d7b2ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb6f4d9-e422-473d-a1e1-c362d7b2ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160953461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2c7983-72a8-4633-a503-02573e0ac178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ce3d3bffd1472193913851c4e11fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:44Z,use_quota=True,user_id='ba716faf017744dab0dcd543bded1e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc16795-cf0d-415b-ade5-ebd1b66c1051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc16795-cf0d-415b-ade5-ebd1b66c1051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1513083-265b-47ba-a8d9-14f699edd067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1513083-265b-47ba-a8d9-14f699edd067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2c7983-72a8-4633-a503-02573e0ac178', 'volume_name': 'volume-ff2c7983-72a8-4633-a503-02573e0ac178', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6212da0d-107a-42ef-930b-e449e251949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6212da0d-107a-42ef-930b-e449e251949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372391e7-8072-4f32-b6e0-5bf409c70977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:43 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Volume ff2c7983-72a8-4633-a503-02573e0ac178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2c7983-72a8-4633-a503-02573e0ac178', 'volume_size': 1} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160953461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2c7983-72a8-4633-a503-02573e0ac178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ce3d3bffd1472193913851c4e11fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:44Z,use_quota=True,user_id='ba716faf017744dab0dcd543bded1e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Creating volume ff2c7983-72a8-4633-a503-02573e0ac178 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:43 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 1073741824 Nov 06 21:36:43 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6" returned: 0 in 0.457s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6 Nov 06 21:36:43 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-77499feb-d922-42d4-bb07-1d57c03ee370-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-77499feb-d922-42d4-bb07-1d57c03ee370-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-77499feb-d922-42d4-bb07-1d57c03ee370" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-77499feb-d922-42d4-bb07-1d57c03ee370" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2d146b-9367-4741-b3f0-16ace6f679aa]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ca8b8664-a205-432e-9c6c-fb17faefd1d6" returned: 0 in 0.367s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 Nov 06 21:36:44 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-quobyte-ca8b8664-a205-432e-9c6c-fb17faefd1d6" released by "delete_volume" :: held 0.891s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Created reservations ['c2e6a56a-48bb-4321-89bc-cadeec4f16d0', '96fe7180-807f-482a-9a81-352b9c07760c', '537c734f-8426-43a2-8b4d-e03ee5c7b0f5', '4b8c0722-43a6-433e-95dc-267da7937984'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 1073741824" returned: 0 in 0.734s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:44 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 Nov 06 21:36:44 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370" returned: 0 in 0.706s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.377s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Deleted volume successfully. Nov 06 21:36:44 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370 Nov 06 21:36:44 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-76fdfb8d-9c0d-4c75-bc5d-cf82451c56ba tempest-CreateVolumesFromSourceVolumeTest-2126098800 None] Lock "cinder-ca8b8664-a205-432e-9c6c-fb17faefd1d6-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:44 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178" returned: 0 in 0.339s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372391e7-8072-4f32-b6e0-5bf409c70977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2c7983-72a8-4633-a503-02573e0ac178', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0108d0b5-480f-4a2a-879e-5d75064278a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:44 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Volume volume-ff2c7983-72a8-4633-a503-02573e0ac178 (ff2c7983-72a8-4633-a503-02573e0ac178): created successfully Nov 06 21:36:44 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0108d0b5-480f-4a2a-879e-5d75064278a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Flow 'volume_create_manager' (be152635-9630-4c2e-9a83-62595ab9cb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bbbef10c-37e4-42cb-8a9b-08f1b049b55e tempest-ProjectReaderTests-1834810983 None] Created volume successfully. Nov 06 21:36:45 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-77499feb-d922-42d4-bb07-1d57c03ee370" returned: 0 in 0.325s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-77499feb-d922-42d4-bb07-1d57c03ee370" released by "delete_volume" :: held 1.098s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created reservations ['2f4a51b0-4d4e-4989-b360-38bfc355e70b', 'b0cc619e-f92c-47e3-97e9-b1f1fddf39a2', '47e17d56-6151-45cd-a3b1-55bb42a68e9a', 'eae1d9b8-f015-4ddc-b37e-99c058e1a380'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:45 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:45 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:45 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.310s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Deleted volume successfully. Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-c682a70c-edd0-439d-8a4c-cd0c753060f1 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-77499feb-d922-42d4-bb07-1d57c03ee370-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Acquiring lock "cinder-ff2c7983-72a8-4633-a503-02573e0ac178-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Lock "cinder-ff2c7983-72a8-4633-a503-02573e0ac178-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Acquiring lock "cinder-quobyte-ff2c7983-72a8-4633-a503-02573e0ac178" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Lock "cinder-quobyte-ff2c7983-72a8-4633-a503-02573e0ac178" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[15084744-da40-44d7-aab4-cb6fc9a096f2]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 Nov 06 21:36:46 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-afe5d0b4-68c9-4e92-994b-11030df13f0d-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-afe5d0b4-68c9-4e92-994b-11030df13f0d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-afe5d0b4-68c9-4e92-994b-11030df13f0d" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-afe5d0b4-68c9-4e92-994b-11030df13f0d" acquired by "delete_volume" :: waited 0.027s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9b981e-ac38-4fd6-9516-1343ef1b7d14]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178" returned: 0 in 0.525s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178 Nov 06 21:36:46 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d Nov 06 21:36:46 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ff2c7983-72a8-4633-a503-02573e0ac178" returned: 0 in 0.334s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Lock "cinder-quobyte-ff2c7983-72a8-4633-a503-02573e0ac178" released by "delete_volume" :: held 0.930s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:46 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d" returned: 0 in 0.461s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d Nov 06 21:36:46 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Created reservations ['059adf02-8fb0-457c-954f-9fe5a5444f03', 'c5950ffb-2d52-49aa-b69e-9ffcb7b162f2', '66c4c926-2263-4bdd-9e74-c9100068cb13', '25d74cfb-0ec9-433b-a793-e1f4fde3aac5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:47 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:47 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:47 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-afe5d0b4-68c9-4e92-994b-11030df13f0d" returned: 0 in 0.476s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:47 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.362s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-afe5d0b4-68c9-4e92-994b-11030df13f0d" released by "delete_volume" :: held 1.022s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Deleted volume successfully. Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-57a8b2ea-6f17-4422-9ce0-f1bf5035a363 tempest-ProjectReaderTests-1834810983 None] Lock "cinder-ff2c7983-72a8-4633-a503-02573e0ac178-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created reservations ['67d0de21-f09b-435f-9745-cd2f3f228675', '9e0e6cb3-5197-439a-a5b6-2edd7a39bc98', '60933173-60fa-41bc-b9ea-674ca63e26bc', '1cc90b2a-358e-4de9-8db1-7e0bf501776b'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:47 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:47 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:48 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.324s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:48 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Deleted volume successfully. Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abe54705-1744-4d9f-8c90-81bfe1dbbb73 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-afe5d0b4-68c9-4e92-994b-11030df13f0d-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-9db35270-805a-492b-ad03-88d74b0b6949-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-9db35270-805a-492b-ad03-88d74b0b6949-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-9db35270-805a-492b-ad03-88d74b0b6949" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-9db35270-805a-492b-ad03-88d74b0b6949" acquired by "delete_volume" :: waited 0.022s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08b158-2c65-4797-baf7-71f40bc41424]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:48 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 Nov 06 21:36:48 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:49 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949" returned: 0 in 0.425s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949 Nov 06 21:36:49 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:49 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-9db35270-805a-492b-ad03-88d74b0b6949" returned: 0 in 0.311s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-9db35270-805a-492b-ad03-88d74b0b6949" released by "delete_volume" :: held 0.796s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created reservations ['e727b00c-fae1-4387-aea2-576212350057', '3ef03401-65b3-4328-ae9c-5cee5ee486ab', '6cc33a7d-5ddb-4079-8ea2-b5ead3117395', 'd39086f3-a0f6-4e97-9bcd-02fbb68a8dc6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:49 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-4978a6a5-4f95-41ae-bb81-1dfb329cffad" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-4978a6a5-4f95-41ae-bb81-1dfb329cffad" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:49 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Deleting offline snapshot 8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 of volume 4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:50 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] snapshot_file for this snap is: volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.340s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbebbc4-f4b8-4a95-a672-52396925d871]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Deleted volume successfully. Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-861e482e-0304-4ebb-bb83-9d72be1be501 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-9db35270-805a-492b-ad03-88d74b0b6949-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:50 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 Nov 06 21:36:50 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:50 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" returned: 0 in 0.521s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe316d4-72c5-46a3-aab7-543e77ef60f6]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:50 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad Nov 06 21:36:50 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:51 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad" returned: 0 in 0.427s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:51 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 Nov 06 21:36:51 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:51 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" returned: 0 in 0.401s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:51 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3 Nov 06 21:36:51 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:51 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad.8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" returned: 0 in 0.259s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3" released by "_delete_snapshot" :: held 1.807s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-4978a6a5-4f95-41ae-bb81-1dfb329cffad" released by "delete_snapshot" :: held 1.834s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created reservations ['dbf49094-66d8-4593-bbd8-eca7dd5ef0e2', 'ee5002bc-3fdb-489e-bb4b-51bf2f585c47', '0e9cdc91-ceb4-40f9-b404-e6b050a35f3d', '8e9d0890-5ca4-4f42-a401-3108f92dd0b4'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Delete snapshot completed successfully. Nov 06 21:36:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-05e48691-87ea-4b83-9399-8f8f92c2ab40 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-8d49ebb1-7627-4a90-a79b-17bd8d3a0ba3-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-4978a6a5-4f95-41ae-bb81-1dfb329cffad-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-4978a6a5-4f95-41ae-bb81-1dfb329cffad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "cinder-quobyte-4978a6a5-4f95-41ae-bb81-1dfb329cffad" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-4978a6a5-4f95-41ae-bb81-1dfb329cffad" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f3aad0-0b33-4c4c-8e09-70760b2b8eb9]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:52 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad Nov 06 21:36:52 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:52 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad" returned: 0 in 0.505s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:52 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad Nov 06 21:36:52 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4978a6a5-4f95-41ae-bb81-1dfb329cffad" returned: 0 in 0.281s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-quobyte-4978a6a5-4f95-41ae-bb81-1dfb329cffad" released by "delete_volume" :: held 0.882s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Created reservations ['c9447f28-b01a-465f-9fcf-e46124722e2d', '9179671a-a629-4bd9-b35e-d2df40f3c2ec', '29f208d4-3d0e-4e55-baaa-b3a422133c4a', '0c1b7bcd-0441-44dc-ab52-1eea96801fdf'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:53 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:36:53 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.333s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Deleted volume successfully. Nov 06 21:36:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a0a27a05-c8f2-4f05-8fb5-595c2945e458 tempest-CreateVolumesFromSnapshotTest-1294830850 None] Lock "cinder-4978a6a5-4f95-41ae-bb81-1dfb329cffad-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:03 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=214,cinder:UPDATE=293,cinder:DELETE=31,cinder:INSERT=80 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:03 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=217,cinder:UPDATE=306,cinder:INSERT=79,cinder:DELETE=22 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:03 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (6722b944-f31a-46ea-a428-3035b359845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:03 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f40d42-ef0a-49e3-a48d-4ef5250a7dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f40d42-ef0a-49e3-a48d-4ef5250a7dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266966492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691005d0-7422-485a-bef3-64e7a4c17185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:04Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7e87ad-4316-4bb3-8d02-f7ef4226d425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7e87ad-4316-4bb3-8d02-f7ef4226d425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5aac5f-fd17-4630-9d7b-45d16ccb4c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5aac5f-fd17-4630-9d7b-45d16ccb4c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691005d0-7422-485a-bef3-64e7a4c17185', 'volume_name': 'volume-691005d0-7422-485a-bef3-64e7a4c17185', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38061941-6f18-4aa3-9f1a-a28d2be9cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38061941-6f18-4aa3-9f1a-a28d2be9cce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce9511c-07f2-45f3-a5b5-7bafae9065a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:04 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Volume 691005d0-7422-485a-bef3-64e7a4c17185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691005d0-7422-485a-bef3-64e7a4c17185', 'volume_size': 1} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266966492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691005d0-7422-485a-bef3-64e7a4c17185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:04Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Creating volume 691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:04 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:04 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 1073741824 Nov 06 21:37:04 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:04 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 1073741824" returned: 0 in 0.676s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:04 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 Nov 06 21:37:04 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:05 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185" returned: 0 in 0.301s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:05 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce9511c-07f2-45f3-a5b5-7bafae9065a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691005d0-7422-485a-bef3-64e7a4c17185', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c5cf0b-6c65-465f-8c0b-888161eac4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:05 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Volume volume-691005d0-7422-485a-bef3-64e7a4c17185 (691005d0-7422-485a-bef3-64e7a4c17185): created successfully Nov 06 21:37:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c5cf0b-6c65-465f-8c0b-888161eac4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:05 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (6722b944-f31a-46ea-a428-3035b359845c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5b36509a-ed8c-41e5-a915-c58567c8bddf tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:37:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:06 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot ba2f2aac-e624-45ca-98bb-3dcba3b23a34 of volume 691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c377ec-bde4-4f2d-97d1-7a2259b0dbdb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:06 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 Nov 06 21:37:06 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:06 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185" returned: 0 in 0.440s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:06 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 1G Nov 06 21:37:06 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:07 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 1G" returned: 0 in 0.594s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691005d0-7422-485a-bef3-64e7a4c17185 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:07 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691005d0-7422-485a-bef3-64e7a4c17185 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 Nov 06 21:37:07 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:07 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691005d0-7422-485a-bef3-64e7a4c17185 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34" returned: 0 in 0.369s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:07 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 is being set with open permissions: ugo+rw Nov 06 21:37:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:07 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 Nov 06 21:37:07 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:08 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34" returned: 0 in 0.280s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:08 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.info Nov 06 21:37:08 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:08 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.info" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:08 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.info is being set with open permissions: ugo+rw Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:08 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.info Nov 06 21:37:08 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:08 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.info" returned: 0 in 0.303s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-28569888-76ba-40e4-862a-7a7053da0cab tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Flow 'volume_create_manager' (4236fcbd-15b0-409d-b847-2fccd3ad38bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026fd811-c2f7-478d-beae-0a6c9e023b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026fd811-c2f7-478d-beae-0a6c9e023b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-811191413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37782153-bd0d-49b2-8a8e-06bf292a84c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ededdb3d87940a88e4261d6c120ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:09Z,use_quota=True,user_id='068e6be86b05454c9e7b03babd3be9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8d8684-3395-43ef-92a3-ba7835c457a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8d8684-3395-43ef-92a3-ba7835c457a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb88677f-c2a9-4f58-9533-36eb7ad6c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb88677f-c2a9-4f58-9533-36eb7ad6c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37782153-bd0d-49b2-8a8e-06bf292a84c7', 'volume_name': 'volume-37782153-bd0d-49b2-8a8e-06bf292a84c7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d3688e-5ca2-4b26-a798-3e820f41d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d3688e-5ca2-4b26-a798-3e820f41d921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14018b8b-a0e8-4575-a977-63791bf47957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:08 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Volume 37782153-bd0d-49b2-8a8e-06bf292a84c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37782153-bd0d-49b2-8a8e-06bf292a84c7', 'volume_size': 1} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-811191413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37782153-bd0d-49b2-8a8e-06bf292a84c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ededdb3d87940a88e4261d6c120ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:09Z,use_quota=True,user_id='068e6be86b05454c9e7b03babd3be9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Creating volume 37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:08 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:08 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 1073741824 Nov 06 21:37:08 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 1073741824" returned: 0 in 0.437s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 Nov 06 21:37:09 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-ba2f2aac-e624-45ca-98bb-3dcba3b23a34-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-ba2f2aac-e624-45ca-98bb-3dcba3b23a34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-691005d0-7422-485a-bef3-64e7a4c17185" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-691005d0-7422-485a-bef3-64e7a4c17185" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-ba2f2aac-e624-45ca-98bb-3dcba3b23a34" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-ba2f2aac-e624-45ca-98bb-3dcba3b23a34" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot ba2f2aac-e624-45ca-98bb-3dcba3b23a34 of volume 691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2f026a-7301-4663-b0c6-1048382a4ac0]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14018b8b-a0e8-4575-a977-63791bf47957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37782153-bd0d-49b2-8a8e-06bf292a84c7', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b55da54-2178-4a75-9fbd-92ceb170daf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:09 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Volume volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 (37782153-bd0d-49b2-8a8e-06bf292a84c7): created successfully Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b55da54-2178-4a75-9fbd-92ceb170daf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:09 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Flow 'volume_create_manager' (4236fcbd-15b0-409d-b847-2fccd3ad38bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:09 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 Nov 06 21:37:09 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-8a98a890-0a8d-4f77-a20b-5bb20d63ff37 tempest-SnapshotDependencyTests-505712246 None] Created volume successfully. Nov 06 21:37:10 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34" returned: 0 in 0.456s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-691005d0-7422-485a-bef3-64e7a4c17185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fc3ddb-53ac-4fdc-8443-a444befa1a71]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Creating offline snapshot 1f7a6039-c897-470e-ac74-340a9c62d7d8 of volume 37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5b3e38-65a8-4492-8713-150730beb1f1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 Nov 06 21:37:10 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 Nov 06 21:37:10 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185" returned: 0 in 0.399s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 Nov 06 21:37:10 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7" returned: 0 in 0.394s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 1G Nov 06 21:37:10 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34" returned: 0 in 0.338s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34 Nov 06 21:37:10 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 1G" returned: 0 in 0.418s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 Nov 06 21:37:11 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:11 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185.ba2f2aac-e624-45ca-98bb-3dcba3b23a34" returned: 0 in 0.289s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-ba2f2aac-e624-45ca-98bb-3dcba3b23a34" released by "_delete_snapshot" :: held 1.640s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-691005d0-7422-485a-bef3-64e7a4c17185" released by "delete_snapshot" :: held 1.666s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Created reservations ['80b84159-96c6-4911-b4cd-762badf486f3', 'e752cd5f-9f40-4352-a331-be503ed56048', 'f602f20b-91d2-490d-9bf0-b130e46b82a3', 'acf2e9d2-58e3-4950-8dd3-afe777c69b80'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:11 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-51a9de09-c551-4000-99a8-aa9a3395b293 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-ba2f2aac-e624-45ca-98bb-3dcba3b23a34-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:11 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 is being set with open permissions: ugo+rw Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.319s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:37:11 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 Nov 06 21:37:11 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8" returned: 0 in 0.288s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-691005d0-7422-485a-bef3-64e7a4c17185-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Lock "cinder-691005d0-7422-485a-bef3-64e7a4c17185-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:11 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.info Nov 06 21:37:11 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-691005d0-7422-485a-bef3-64e7a4c17185" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-691005d0-7422-485a-bef3-64e7a4c17185" acquired by "delete_volume" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[028dbe8b-a78c-4aad-9929-31ac6750656c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 Nov 06 21:37:12 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:12 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.info" returned: 0 in 0.331s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.info is being set with open permissions: ugo+rw Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.info Nov 06 21:37:12 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:12 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185" returned: 0 in 0.428s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185 Nov 06 21:37:12 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:12 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.info" returned: 0 in 0.299s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:12 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6ed5fd79-8fbd-48c2-9d22-3a34cec10e1c tempest-SnapshotDependencyTests-505712246 None] Create snapshot completed successfully Nov 06 21:37:12 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-691005d0-7422-485a-bef3-64e7a4c17185" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-691005d0-7422-485a-bef3-64e7a4c17185" released by "delete_volume" :: held 0.771s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Created reservations ['44b9c674-8ae3-454f-aec6-6d35c268a40a', '0c5b1537-6f7b-4ef0-89dd-6fca293d9a25', '7585683c-6e02-4579-aced-6263510fa397', '0f3e9055-eadf-4e5c-8955-922704a5c3e9'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:12 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.249s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d08f0a2a-b713-4e93-b425-de56923aec6c tempest-ProjectMemberTests-1866665000 None] Lock "cinder-691005d0-7422-485a-bef3-64e7a4c17185-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (0437f89d-6b5f-4563-95a5-d8c83d4fc323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f10612-f219-4020-88db-7ae4aefae696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f10612-f219-4020-88db-7ae4aefae696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710269052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567fd606-2a93-46b0-bd17-d3cfe3478916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:13Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549dfcf-29f0-4ec3-921c-bcfaeb940a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549dfcf-29f0-4ec3-921c-bcfaeb940a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7733904-a6c1-4d5b-bdbf-51365a2147b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7733904-a6c1-4d5b-bdbf-51365a2147b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567fd606-2a93-46b0-bd17-d3cfe3478916', 'volume_name': 'volume-567fd606-2a93-46b0-bd17-d3cfe3478916', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b9335b-05ee-4a90-abe8-0cdadb39dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b9335b-05ee-4a90-abe8-0cdadb39dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfa8545-bc60-4af6-83ea-bc13964207e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:13 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Volume 567fd606-2a93-46b0-bd17-d3cfe3478916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567fd606-2a93-46b0-bd17-d3cfe3478916', 'volume_size': 1} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710269052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567fd606-2a93-46b0-bd17-d3cfe3478916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:13Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Creating volume 567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:13 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 1073741824 Nov 06 21:37:13 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 1073741824" returned: 0 in 0.534s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 Nov 06 21:37:14 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Flow 'volume_create_manager' (dfd46a2f-a317-4362-820d-5072d2502291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e65afc-3cb5-484c-b8c7-82b14235aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e65afc-3cb5-484c-b8c7-82b14235aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe90311c-b6b2-41b5-8d6d-7ed5a9334828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ededdb3d87940a88e4261d6c120ce12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f7a6039-c897-470e-ac74-340a9c62d7d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:14Z,use_quota=True,user_id='068e6be86b05454c9e7b03babd3be9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45d32c4-23e1-4e36-8c2c-afe73bfbcdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45d32c4-23e1-4e36-8c2c-afe73bfbcdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f124892-7c17-402e-8fa1-ff7a9c2b54e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f124892-7c17-402e-8fa1-ff7a9c2b54e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe90311c-b6b2-41b5-8d6d-7ed5a9334828', 'volume_name': 'volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828', 'volume_size': 1, 'snapshot_id': '1f7a6039-c897-470e-ac74-340a9c62d7d8'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0608f82f-a00c-40e2-9aae-d83eb074c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0608f82f-a00c-40e2-9aae-d83eb074c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9807236-8f5c-455c-a42a-9bb49819b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Volume fe90311c-b6b2-41b5-8d6d-7ed5a9334828: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828', 'volume_size': 1, 'snapshot_id': '1f7a6039-c897-470e-ac74-340a9c62d7d8'} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:14 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916" returned: 0 in 0.283s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.122s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-quobyte-1f7a6039-c897-470e-ac74-340a9c62d7d8-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" by "_create_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfa8545-bc60-4af6-83ea-bc13964207e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567fd606-2a93-46b0-bd17-d3cfe3478916', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8d1835-dc7f-4c6f-b70c-e28dda7b6262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-1f7a6039-c897-470e-ac74-340a9c62d7d8-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Creating volume fe90311c-b6b2-41b5-8d6d-7ed5a9334828 from snapshot 1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-quobyte-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" by "_copy_volume_from_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:14 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Volume volume-567fd606-2a93-46b0-bd17-d3cfe3478916 (567fd606-2a93-46b0-bd17-d3cfe3478916): created successfully Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8d1835-dc7f-4c6f-b70c-e28dda7b6262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (0437f89d-6b5f-4563-95a5-d8c83d4fc323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:14 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4272cc07-5562-4211-9376-2c25f56635d8 tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] snapshot: 1f7a6039-c897-470e-ac74-340a9c62d7d8, volume: fe90311c-b6b2-41b5-8d6d-7ed5a9334828, {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d3ec84-1ac4-4fd4-9db8-d3dfef6c0428]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 Nov 06 21:37:14 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8" returned: 0 in 0.378s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37782153-bd0d-49b2-8a8e-06bf292a84c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f829eaa-64cb-43cf-bfaa-27470c4beaec]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 Nov 06 21:37:15 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7" returned: 0 in 0.381s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:37:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Creating direct copy from snapshot {{(pid=87450) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:37:15 devstack cinder-volume[87450]: DEBUG cinder.utils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Path /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 not found in is_blk_device check {{(pid=87450) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:37:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 Nov 06 21:37:15 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (643dd9bd-9e83-4dbb-a824-140dc8353e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94212baa-d40e-4446-8d8d-17c825c39728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94212baa-d40e-4446-8d8d-17c825c39728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373437007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001adc90-8b43-4121-a57f-fbaad947ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:21Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e08691-bc51-48c2-bc57-7fc8b5c0b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e08691-bc51-48c2-bc57-7fc8b5c0b082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15976bd-feb9-407a-a9df-1874c9163a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15976bd-feb9-407a-a9df-1874c9163a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001adc90-8b43-4121-a57f-fbaad947ea69', 'volume_name': 'volume-001adc90-8b43-4121-a57f-fbaad947ea69', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3716909e-0597-4a59-b133-0ef8cd346189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3716909e-0597-4a59-b133-0ef8cd346189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d46108-9e84-483e-ae9a-ef6dc3c0ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:20 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Volume 001adc90-8b43-4121-a57f-fbaad947ea69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001adc90-8b43-4121-a57f-fbaad947ea69', 'volume_size': 1} Nov 06 21:37:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:21 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" returned: 0 in 6.455s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:21 devstack cinder-volume[87450]: DEBUG cinder.image.image_utils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Image conversion details: src /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 {{(pid=87450) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:37:21 devstack cinder-volume[87450]: INFO cinder.image.image_utils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Converted 1024.00 MB image at 158.63 MB/s Nov 06 21:37:21 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 is being set with open permissions: ugo+rw Nov 06 21:37:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:21 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 Nov 06 21:37:21 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:21 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" returned: 0 in 0.252s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" released by "_copy_volume_from_snapshot" :: held 7.561s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-1f7a6039-c897-470e-ac74-340a9c62d7d8-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" released by "_create_volume_from_snapshot" :: held 7.642s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.678s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.284s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot 7a81f40e-2c58-4b54-b9f6-226f543ff34c of volume 567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9807236-8f5c-455c-a42a-9bb49819b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828', 'volume_size': 1, 'snapshot_id': '1f7a6039-c897-470e-ac74-340a9c62d7d8'}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f41dbd-4aee-432b-b8ff-246a6c2ffae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[01805ca9-c35c-41bc-a91a-1808f73795ce]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:22 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Volume volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 (fe90311c-b6b2-41b5-8d6d-7ed5a9334828): created successfully Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f41dbd-4aee-432b-b8ff-246a6c2ffae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Flow 'volume_create_manager' (dfd46a2f-a317-4362-820d-5072d2502291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:22 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-26ed7f4e-5874-4146-8e35-2f5e2fce5695 tempest-SnapshotDependencyTests-505712246 None] Created volume successfully. Nov 06 21:37:22 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 Nov 06 21:37:22 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:22 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916" returned: 0 in 0.348s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:22 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c 1G Nov 06 21:37:22 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:22 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c 1G" returned: 0 in 0.401s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:22 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567fd606-2a93-46b0-bd17-d3cfe3478916 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:22 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567fd606-2a93-46b0-bd17-d3cfe3478916 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c Nov 06 21:37:22 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-1f7a6039-c897-470e-ac74-340a9c62d7d8-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-1f7a6039-c897-470e-ac74-340a9c62d7d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-quobyte-37782153-bd0d-49b2-8a8e-06bf292a84c7" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-37782153-bd0d-49b2-8a8e-06bf292a84c7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-quobyte-1f7a6039-c897-470e-ac74-340a9c62d7d8" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-1f7a6039-c897-470e-ac74-340a9c62d7d8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Deleting offline snapshot 1f7a6039-c897-470e-ac74-340a9c62d7d8 of volume 37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:23 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] snapshot_file for this snap is: volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567fd606-2a93-46b0-bd17-d3cfe3478916 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c" returned: 0 in 0.327s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c is being set with open permissions: ugo+rw Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d9e3c-015e-4516-9a0f-01d1272d23c3]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:23 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c Nov 06 21:37:23 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 Nov 06 21:37:23 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c" returned: 0 in 0.241s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:23 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.info Nov 06 21:37:23 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8" returned: 0 in 0.371s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37782153-bd0d-49b2-8a8e-06bf292a84c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65de0a0-f3e8-485f-bde1-7755ce5b5028]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:23 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 Nov 06 21:37:23 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.info" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.info is being set with open permissions: ugo+rw Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:23 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.info Nov 06 21:37:23 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.info" returned: 0 in 0.256s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.072s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373437007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001adc90-8b43-4121-a57f-fbaad947ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:21Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Creating volume 001adc90-8b43-4121-a57f-fbaad947ea69 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:23 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:23 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 1073741824 Nov 06 21:37:24 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e745a27f-5ad1-4d5e-bc76-fe1fe1940c20 tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:37:24 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7" returned: 0 in 0.599s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-7a81f40e-2c58-4b54-b9f6-226f543ff34c-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-7a81f40e-2c58-4b54-b9f6-226f543ff34c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:24 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-567fd606-2a93-46b0-bd17-d3cfe3478916" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-567fd606-2a93-46b0-bd17-d3cfe3478916" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-7a81f40e-2c58-4b54-b9f6-226f543ff34c" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-7a81f40e-2c58-4b54-b9f6-226f543ff34c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot 7a81f40e-2c58-4b54-b9f6-226f543ff34c of volume 567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f551ba4-a662-483c-bae8-e9a0510e3e95]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c Nov 06 21:37:24 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:24 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 1073741824" returned: 0 in 0.466s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 Nov 06 21:37:24 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:24 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8" returned: 0 in 0.385s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8 Nov 06 21:37:24 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:24 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c" returned: 0 in 0.428s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-567fd606-2a93-46b0-bd17-d3cfe3478916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:24 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69" returned: 0 in 0.279s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e56cc-5ffe-462e-a4af-3c9857063e2a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d46108-9e84-483e-ae9a-ef6dc3c0ea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001adc90-8b43-4121-a57f-fbaad947ea69', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a408c5-d3f5-441a-9d48-1043d3279622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:24 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Volume volume-001adc90-8b43-4121-a57f-fbaad947ea69 (001adc90-8b43-4121-a57f-fbaad947ea69): created successfully Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a408c5-d3f5-441a-9d48-1043d3279622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (643dd9bd-9e83-4dbb-a824-140dc8353e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:24 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0a13e9db-bd02-40ec-b317-316b506a07e8 tempest-ProjectReaderTests-1994937388 None] Created volume successfully. Nov 06 21:37:24 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7.1f7a6039-c897-470e-ac74-340a9c62d7d8" returned: 0 in 0.302s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:24 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 Nov 06 21:37:24 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-1f7a6039-c897-470e-ac74-340a9c62d7d8" released by "_delete_snapshot" :: held 1.778s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-37782153-bd0d-49b2-8a8e-06bf292a84c7" released by "delete_snapshot" :: held 1.802s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:24 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Created reservations ['13962baa-7563-4b4a-83f9-5263053e0042', '3f1bd126-9bf9-4777-8e46-b6bb740e3432', '97d0037b-8acf-4423-8ad8-adb51723c1e8', '8bdafa3c-8705-41ed-84be-6ad81d1dbc82'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Delete snapshot completed successfully. Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-09d92cda-6f23-4164-8b49-e8dca5caaa9f tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-1f7a6039-c897-470e-ac74-340a9c62d7d8-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:25 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916" returned: 0 in 0.369s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:25 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c Nov 06 21:37:25 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-37782153-bd0d-49b2-8a8e-06bf292a84c7-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-37782153-bd0d-49b2-8a8e-06bf292a84c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-quobyte-37782153-bd0d-49b2-8a8e-06bf292a84c7" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-37782153-bd0d-49b2-8a8e-06bf292a84c7" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[2261cc79-dd57-43fe-9342-38b1187a785a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:25 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c" returned: 0 in 0.376s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:25 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 Nov 06 21:37:25 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c Nov 06 21:37:25 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916.7a81f40e-2c58-4b54-b9f6-226f543ff34c" returned: 0 in 0.250s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7" returned: 0 in 0.375s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:25 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7 Nov 06 21:37:25 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-7a81f40e-2c58-4b54-b9f6-226f543ff34c" released by "_delete_snapshot" :: held 1.566s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-567fd606-2a93-46b0-bd17-d3cfe3478916" released by "delete_snapshot" :: held 1.591s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Created reservations ['326b422c-af7d-4c29-9e1f-07aa53a5ccf7', 'ad387371-32cb-4917-b5a1-fd94d53d6cf2', '0bf736b2-1d69-46cc-81e0-948ddd0f773d', '2ebb2e92-9cf5-4ec4-8c10-301c1fa84877'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:25 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:37:25 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d1bcf93b-bb7a-4419-b553-81ee1146e8a3 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-7a81f40e-2c58-4b54-b9f6-226f543ff34c-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:26 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-37782153-bd0d-49b2-8a8e-06bf292a84c7" returned: 0 in 0.254s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-37782153-bd0d-49b2-8a8e-06bf292a84c7" released by "delete_volume" :: held 0.714s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Created reservations ['55ba76be-a202-4c95-80ec-9003d02fb6d3', 'f49f6e66-5c2f-40a1-97b1-d36fa593b5b1', '75d3862b-f34f-4bb4-941e-798a9fe2bbbf', '16391225-e0ad-4350-af2c-6367c24e6122'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-001adc90-8b43-4121-a57f-fbaad947ea69-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Lock "cinder-001adc90-8b43-4121-a57f-fbaad947ea69-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-quobyte-001adc90-8b43-4121-a57f-fbaad947ea69" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:26 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:26 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-001adc90-8b43-4121-a57f-fbaad947ea69" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3aca8-2080-4f7e-91d8-911dc637046b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 Nov 06 21:37:26 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-567fd606-2a93-46b0-bd17-d3cfe3478916-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-567fd606-2a93-46b0-bd17-d3cfe3478916-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-fe90311c-b6b2-41b5-8d6d-7ed5a9334828-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-fe90311c-b6b2-41b5-8d6d-7ed5a9334828-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-567fd606-2a93-46b0-bd17-d3cfe3478916" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-567fd606-2a93-46b0-bd17-d3cfe3478916" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:26 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.360s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Deleted volume successfully. Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec68653-6aaf-461d-a085-c0092feb51d7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "cinder-quobyte-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" acquired by "delete_volume" :: waited 0.038s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-0ab21ac0-8ff8-4334-b26c-8349e21834a9 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-37782153-bd0d-49b2-8a8e-06bf292a84c7-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a23c246-4df8-4b77-a1c3-8ec2f4ffbcab]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 Nov 06 21:37:26 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69" returned: 0 in 0.487s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 Nov 06 21:37:26 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69 Nov 06 21:37:26 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916" returned: 0 in 0.395s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916 Nov 06 21:37:27 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-001adc90-8b43-4121-a57f-fbaad947ea69" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-001adc90-8b43-4121-a57f-fbaad947ea69" released by "delete_volume" :: held 0.798s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:27 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" returned: 0 in 0.397s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828 Nov 06 21:37:27 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Created reservations ['4223d5ce-1d42-4b46-b96b-5508a99ad8fa', '5ac9a12e-16a2-4fc1-8ccd-89960691b341', 'e5ae9181-abe4-4118-a843-e5af477ee7ff', 'bd85f5b6-4080-410c-a693-a19f2c92982e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:27 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-567fd606-2a93-46b0-bd17-d3cfe3478916" returned: 0 in 0.278s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-567fd606-2a93-46b0-bd17-d3cfe3478916" released by "delete_volume" :: held 0.766s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:27 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" returned: 0 in 0.284s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-quobyte-fe90311c-b6b2-41b5-8d6d-7ed5a9334828" released by "delete_volume" :: held 0.730s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Created reservations ['fa18274d-b135-4230-b91c-be90e7894f18', '6699ffea-4676-40d6-844d-f47b7385ed7c', 'edfd9a6f-3f7e-446b-9117-c726f84014ae', '750478d9-5815-4b70-a9a3-67f33c689003'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Created reservations ['97e105ae-ac1f-47a8-a110-3ec3c5741bc0', '76d60d6a-421d-44e4-aa2c-4ac2b3ba22fb', '1b17a103-3bc9-46aa-a8a5-6b1316affeab', 'c33a7b03-3af3-4618-bf18-bc4a7e1d600f'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.316s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:27 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Deleted volume successfully. Nov 06 21:37:27 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-2d07a340-43c1-422e-b65d-d6f59eb32cb8 tempest-ProjectReaderTests-1994937388 None] Lock "cinder-001adc90-8b43-4121-a57f-fbaad947ea69-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:27 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.361s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:27 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-e6e10693-f90b-46b1-a190-47679f83431b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-567fd606-2a93-46b0-bd17-d3cfe3478916-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:27 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.418s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Deleted volume successfully. Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (59b57d0d-a43c-4d4f-9115-ad62edd377e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259486f5-ae1b-4de3-8cd6-e2cc7db0d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-a29438a3-0299-4b17-a17a-09cccc7723d3 tempest-SnapshotDependencyTests-505712246 None] Lock "cinder-fe90311c-b6b2-41b5-8d6d-7ed5a9334828-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259486f5-ae1b-4de3-8cd6-e2cc7db0d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698733901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8ed07b-8c09-43f1-b157-63e2b95a746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:28Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f4096-5659-47e2-9d34-1b508bd3f6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f4096-5659-47e2-9d34-1b508bd3f6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901b124a-b632-45a3-a364-85fdd0bd9b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901b124a-b632-45a3-a364-85fdd0bd9b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8ed07b-8c09-43f1-b157-63e2b95a746b', 'volume_name': 'volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eb6ac6-feff-4ef9-acfd-aa0b0b54d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eb6ac6-feff-4ef9-acfd-aa0b0b54d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0abdf4-c0a9-46a8-9215-cf874a0374dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Volume 4c8ed07b-8c09-43f1-b157-63e2b95a746b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b', 'volume_size': 1} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698733901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8ed07b-8c09-43f1-b157-63e2b95a746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:28Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Creating volume 4c8ed07b-8c09-43f1-b157-63e2b95a746b {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:28 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b 1073741824 Nov 06 21:37:28 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (580bd407-531a-45e4-a517-2a8cea374023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5677e08-e912-4d70-a68d-1ee087d72d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5677e08-e912-4d70-a68d-1ee087d72d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114344333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82f6cb8-2f5b-485c-9177-31b0eb28b432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:28Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a79f66-772a-410b-893f-5f1e633c1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a79f66-772a-410b-893f-5f1e633c1457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cbbf52-a504-472e-b56c-60f40a321759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cbbf52-a504-472e-b56c-60f40a321759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82f6cb8-2f5b-485c-9177-31b0eb28b432', 'volume_name': 'volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c3d574-9645-4bb0-b54c-09ec76ce2e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c3d574-9645-4bb0-b54c-09ec76ce2e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec44ae22-486d-4db6-9da3-72d4b6b3efa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Volume a82f6cb8-2f5b-485c-9177-31b0eb28b432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432', 'volume_size': 1} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:28 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b 1073741824" returned: 0 in 0.433s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b Nov 06 21:37:28 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:28 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b" returned: 0 in 0.298s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114344333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82f6cb8-2f5b-485c-9177-31b0eb28b432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:28Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Creating volume a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:28 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0abdf4-c0a9-46a8-9215-cf874a0374dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:28 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 1073741824 Nov 06 21:37:28 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12a4c1d-278e-4891-89ca-f20dd8806c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:28 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:28 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Volume volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b (4c8ed07b-8c09-43f1-b157-63e2b95a746b): created successfully Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12a4c1d-278e-4891-89ca-f20dd8806c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (59b57d0d-a43c-4d4f-9115-ad62edd377e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-98c6095a-0cb2-454b-829e-939d961605ae tempest-ProjectReaderTests-1994937388 None] Created volume successfully. Nov 06 21:37:29 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 1073741824" returned: 0 in 0.453s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:29 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 Nov 06 21:37:29 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432" returned: 0 in 0.267s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec44ae22-486d-4db6-9da3-72d4b6b3efa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a621de52-5fb0-460a-85a9-c45b7d146a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:29 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Volume volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 (a82f6cb8-2f5b-485c-9177-31b0eb28b432): created successfully Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a621de52-5fb0-460a-85a9-c45b7d146a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:29 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (580bd407-531a-45e4-a517-2a8cea374023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:29 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-427a224b-d281-4279-8f9f-ed216f7129e0 tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-4c8ed07b-8c09-43f1-b157-63e2b95a746b-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Lock "cinder-4c8ed07b-8c09-43f1-b157-63e2b95a746b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-quobyte-4c8ed07b-8c09-43f1-b157-63e2b95a746b" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-4c8ed07b-8c09-43f1-b157-63e2b95a746b" acquired by "delete_volume" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[316b41ab-e47f-4c9d-b4cb-6c644e68fa00]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b Nov 06 21:37:30 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot a5356103-4a1b-4010-bf7c-0619a775e5fa of volume a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:30 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b" returned: 0 in 0.471s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f922d8-980f-4d22-83cd-413ad8dde1d0]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b Nov 06 21:37:30 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 Nov 06 21:37:30 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-4c8ed07b-8c09-43f1-b157-63e2b95a746b" returned: 0 in 0.270s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-4c8ed07b-8c09-43f1-b157-63e2b95a746b" released by "delete_volume" :: held 0.783s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:30 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Created reservations ['ceef28a5-6393-4e30-9fe0-ab0c8b98f485', '9344a912-b161-4e88-8e86-cf988fbc5fd6', 'd0f830df-a031-4794-aa9b-5898150d02d9', 'c9e03278-7c45-4244-b110-31429ed22a63'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:31 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432" returned: 0 in 0.389s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:31 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:31 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa 1G Nov 06 21:37:31 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:31 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.255s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:31 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Deleted volume successfully. Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b2b12a2f-9b9f-4f80-8f51-898981cb1baa tempest-ProjectReaderTests-1994937388 None] Lock "cinder-4c8ed07b-8c09-43f1-b157-63e2b95a746b-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:31 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa 1G" returned: 0 in 0.448s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa Nov 06 21:37:31 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (baf91d8a-d2bf-4ef1-8149-b51d07e0350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d3cd27-ce2d-4606-912d-9e285596d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d3cd27-ce2d-4606-912d-9e285596d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708880505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02191398-7a28-48e7-88f3-8df4026a7111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:32Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40646473-32fa-4806-9287-f0bb2f0436ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40646473-32fa-4806-9287-f0bb2f0436ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d776b4b-845a-4fef-92c3-60ac1d6e4ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d776b4b-845a-4fef-92c3-60ac1d6e4ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02191398-7a28-48e7-88f3-8df4026a7111', 'volume_name': 'volume-02191398-7a28-48e7-88f3-8df4026a7111', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa2aeaa-e707-4c87-b0f5-a6f150bea88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa2aeaa-e707-4c87-b0f5-a6f150bea88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0f682f-3c52-4184-874c-81b06995a0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Volume 02191398-7a28-48e7-88f3-8df4026a7111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02191398-7a28-48e7-88f3-8df4026a7111', 'volume_size': 1} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa" returned: 0 in 0.436s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa is being set with open permissions: ugo+rw Nov 06 21:37:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa Nov 06 21:37:31 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa" returned: 0 in 0.251s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.info Nov 06 21:37:32 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.info" returned: 0 in 0.266s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.info is being set with open permissions: ugo+rw Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.info Nov 06 21:37:32 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.info" returned: 0 in 0.279s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708880505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02191398-7a28-48e7-88f3-8df4026a7111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:32Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Creating volume 02191398-7a28-48e7-88f3-8df4026a7111 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:32 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 1073741824 Nov 06 21:37:32 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-896525f2-9f93-4e27-8c66-8a3b3e0b3b31 tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:37:33 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 1073741824" returned: 0 in 0.419s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 Nov 06 21:37:33 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:33 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111" returned: 0 in 0.284s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0f682f-3c52-4184-874c-81b06995a0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02191398-7a28-48e7-88f3-8df4026a7111', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54dc2f6-8e16-4c4b-a32c-bd7d907afea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Volume volume-02191398-7a28-48e7-88f3-8df4026a7111 (02191398-7a28-48e7-88f3-8df4026a7111): created successfully Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54dc2f6-8e16-4c4b-a32c-bd7d907afea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (baf91d8a-d2bf-4ef1-8149-b51d07e0350f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-743ea9fe-ed5a-40af-a1bf-719321f2da1a tempest-ProjectReaderTests-1994937388 None] Created volume successfully. Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-a5356103-4a1b-4010-bf7c-0619a775e5fa-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Lock "cinder-a5356103-4a1b-4010-bf7c-0619a775e5fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-a82f6cb8-2f5b-485c-9177-31b0eb28b432" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a82f6cb8-2f5b-485c-9177-31b0eb28b432" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-a5356103-4a1b-4010-bf7c-0619a775e5fa" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a5356103-4a1b-4010-bf7c-0619a775e5fa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot a5356103-4a1b-4010-bf7c-0619a775e5fa of volume a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[28634761-636a-43d1-8f53-b7e9d198331f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-02191398-7a28-48e7-88f3-8df4026a7111-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:33 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Lock "cinder-02191398-7a28-48e7-88f3-8df4026a7111-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-quobyte-02191398-7a28-48e7-88f3-8df4026a7111" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-02191398-7a28-48e7-88f3-8df4026a7111" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:34 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa Nov 06 21:37:34 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f57258-c327-4d4a-8acd-6e0e3d8043ce]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 Nov 06 21:37:34 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa" returned: 0 in 0.429s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2214e9-1a4f-4c95-9679-e7b96f560357]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111" returned: 0 in 0.397s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111 Nov 06 21:37:34 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 Nov 06 21:37:34 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-02191398-7a28-48e7-88f3-8df4026a7111" returned: 0 in 0.251s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-02191398-7a28-48e7-88f3-8df4026a7111" released by "delete_volume" :: held 0.695s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Created reservations ['dc449f0a-daa1-40d3-8e51-095bc33de673', '88eb5366-cbdf-447c-ad6a-7dbde5ab960c', 'c5f10a9e-992d-4c05-83b4-5d45d0105cf4', 'a9cb3235-1aca-4187-a5d0-2e7085d66007'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:34 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432" returned: 0 in 0.420s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa Nov 06 21:37:34 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:34 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:35 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.284s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Deleted volume successfully. Nov 06 21:37:35 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa" returned: 0 in 0.404s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-6deda4b3-e81c-4a34-af2e-ebbed124c0db tempest-ProjectReaderTests-1994937388 None] Lock "cinder-02191398-7a28-48e7-88f3-8df4026a7111-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:35 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa Nov 06 21:37:35 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:35 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432.a5356103-4a1b-4010-bf7c-0619a775e5fa" returned: 0 in 0.309s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a5356103-4a1b-4010-bf7c-0619a775e5fa" released by "_delete_snapshot" :: held 1.691s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a82f6cb8-2f5b-485c-9177-31b0eb28b432" released by "delete_snapshot" :: held 1.720s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Created reservations ['c985754a-12d5-4a25-b997-d5bc27ece32e', '900e7991-9086-456c-af95-82777fd71cb7', '9ee16c51-ec4d-4dce-8095-77859c00cccf', 'df651f8b-105d-449c-8d99-7c54b845bc23'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (f5d6cb3a-6963-490b-af1d-c94752ae41fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a339c2e2-1b4a-43a3-9377-4b50b7508456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a339c2e2-1b4a-43a3-9377-4b50b7508456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440211426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c0397c-c43d-410a-ad2a-a55b667ed022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:36Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e72b01-5341-411e-b4f6-382cded7ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e72b01-5341-411e-b4f6-382cded7ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e294a2-0fbc-4514-b109-150dc7b01e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e294a2-0fbc-4514-b109-150dc7b01e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c0397c-c43d-410a-ad2a-a55b667ed022', 'volume_name': 'volume-75c0397c-c43d-410a-ad2a-a55b667ed022', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ac7cde-60d3-488b-8e0e-40241ef0b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ac7cde-60d3-488b-8e0e-40241ef0b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c28eb9-21f2-491f-9ff1-17bf0a2c7920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:35 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Volume 75c0397c-c43d-410a-ad2a-a55b667ed022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c0397c-c43d-410a-ad2a-a55b667ed022', 'volume_size': 1} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440211426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c0397c-c43d-410a-ad2a-a55b667ed022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8758ae870f8447348e39614a7cb19616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:36Z,use_quota=True,user_id='2ade4eb1c6914829b74922895c52e513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Creating volume 75c0397c-c43d-410a-ad2a-a55b667ed022 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:35 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:35 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-66bf841f-7cf5-4bda-a070-4594a2a4c68f tempest-ProjectMemberTests-1866665000 None] Lock "cinder-a5356103-4a1b-4010-bf7c-0619a775e5fa-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:35 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 1073741824 Nov 06 21:37:35 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-a82f6cb8-2f5b-485c-9177-31b0eb28b432-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Lock "cinder-a82f6cb8-2f5b-485c-9177-31b0eb28b432-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-a82f6cb8-2f5b-485c-9177-31b0eb28b432" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a82f6cb8-2f5b-485c-9177-31b0eb28b432" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a7f3c-a3ef-4555-b838-f760b6842d09]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 Nov 06 21:37:36 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 1073741824" returned: 0 in 0.495s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 Nov 06 21:37:36 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432" returned: 0 in 0.479s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432 Nov 06 21:37:36 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022" returned: 0 in 0.344s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c28eb9-21f2-491f-9ff1-17bf0a2c7920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c0397c-c43d-410a-ad2a-a55b667ed022', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39488c9-369f-4b08-8c25-4ced58d450e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:36 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Volume volume-75c0397c-c43d-410a-ad2a-a55b667ed022 (75c0397c-c43d-410a-ad2a-a55b667ed022): created successfully Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39488c9-369f-4b08-8c25-4ced58d450e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Flow 'volume_create_manager' (f5d6cb3a-6963-490b-af1d-c94752ae41fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:36 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-081cf1af-8878-48ef-83f4-b66974609786 tempest-ProjectReaderTests-1994937388 None] Created volume successfully. Nov 06 21:37:36 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-a82f6cb8-2f5b-485c-9177-31b0eb28b432" returned: 0 in 0.282s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a82f6cb8-2f5b-485c-9177-31b0eb28b432" released by "delete_volume" :: held 0.828s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:36 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Created reservations ['a7783eb1-c235-420d-9a80-abde208ff58a', 'f1eed435-aa38-4f2f-b848-68e78e3ff1af', '77a23681-0fa8-4e34-bdb0-a328ae739313', 'b6a60cb2-3de0-4865-b675-8afb7ff21f7e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:37 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:37 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.308s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d76e8b56-8bb9-462b-8d96-4f81750f3f3e tempest-ProjectMemberTests-1866665000 None] Lock "cinder-a82f6cb8-2f5b-485c-9177-31b0eb28b432-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (372915d6-e538-4ac4-969a-7de28bfe1be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2b541f-8c18-491e-8bbd-b7b96a1bf778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2b541f-8c18-491e-8bbd-b7b96a1bf778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1294418766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770d5edd-844b-48e0-bce7-3d02e5352306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:38Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de61f23-517b-4713-87cc-d14d9fdce0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de61f23-517b-4713-87cc-d14d9fdce0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a734c5-93c4-4503-86d6-4dcb1da0037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a734c5-93c4-4503-86d6-4dcb1da0037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770d5edd-844b-48e0-bce7-3d02e5352306', 'volume_name': 'volume-770d5edd-844b-48e0-bce7-3d02e5352306', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f498196-b49d-4509-825d-e55c71517ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f498196-b49d-4509-825d-e55c71517ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c25c8d2-439f-49c5-b633-640fe43016c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Volume 770d5edd-844b-48e0-bce7-3d02e5352306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770d5edd-844b-48e0-bce7-3d02e5352306', 'volume_size': 1} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1294418766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770d5edd-844b-48e0-bce7-3d02e5352306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:38Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Creating volume 770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:37 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-75c0397c-c43d-410a-ad2a-a55b667ed022-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:37 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 1073741824 Nov 06 21:37:37 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Lock "cinder-75c0397c-c43d-410a-ad2a-a55b667ed022-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Acquiring lock "cinder-quobyte-75c0397c-c43d-410a-ad2a-a55b667ed022" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-75c0397c-c43d-410a-ad2a-a55b667ed022" acquired by "delete_volume" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc193dcc-d71a-4a81-9370-0ea36c1f6035]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 Nov 06 21:37:38 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 1073741824" returned: 0 in 0.566s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022" returned: 0 in 0.443s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022 Nov 06 21:37:38 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 Nov 06 21:37:38 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-75c0397c-c43d-410a-ad2a-a55b667ed022" returned: 0 in 0.368s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Lock "cinder-quobyte-75c0397c-c43d-410a-ad2a-a55b667ed022" released by "delete_volume" :: held 0.863s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:38 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306" returned: 0 in 0.367s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c25c8d2-439f-49c5-b633-640fe43016c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770d5edd-844b-48e0-bce7-3d02e5352306', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4332b775-e088-4961-8eb1-a0ac31323fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:38 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Volume volume-770d5edd-844b-48e0-bce7-3d02e5352306 (770d5edd-844b-48e0-bce7-3d02e5352306): created successfully Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4332b775-e088-4961-8eb1-a0ac31323fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (372915d6-e538-4ac4-969a-7de28bfe1be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:38 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Created reservations ['d2a31c68-383e-4b09-985c-529f4e919576', 'd1c7cd9b-001e-4c8e-aa2d-54a92a990f99', '515fb07b-fa92-47a5-8779-972f5ab43e55', '9e5d1e2a-2995-47ab-b2f7-d79e3d1c19ec'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:38 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5117d887-a17e-4042-aabe-1298356c71ff tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:39 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:39 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:39 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.274s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:39 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Deleted volume successfully. Nov 06 21:37:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-abd8898c-8c25-43f8-b4a5-2a03a2b51d0a tempest-ProjectReaderTests-1994937388 None] Lock "cinder-75c0397c-c43d-410a-ad2a-a55b667ed022-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot 5602254d-969e-4759-94a0-91de361c9a9c of volume 770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d87f1de-3c00-4190-a686-e533da5581a1]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 Nov 06 21:37:40 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c 1G Nov 06 21:37:40 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c 1G" returned: 0 in 0.476s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770d5edd-844b-48e0-bce7-3d02e5352306 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770d5edd-844b-48e0-bce7-3d02e5352306 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c Nov 06 21:37:40 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770d5edd-844b-48e0-bce7-3d02e5352306 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c" returned: 0 in 0.297s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c is being set with open permissions: ugo+rw Nov 06 21:37:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c Nov 06 21:37:41 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c" returned: 0 in 0.237s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.info Nov 06 21:37:41 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.info" returned: 0 in 0.277s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.info is being set with open permissions: ugo+rw Nov 06 21:37:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.info Nov 06 21:37:41 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:42 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.info" returned: 0 in 0.244s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-07888904-946b-4dfa-8928-a6a251aa2913 tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-5602254d-969e-4759-94a0-91de361c9a9c-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-5602254d-969e-4759-94a0-91de361c9a9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-770d5edd-844b-48e0-bce7-3d02e5352306" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-770d5edd-844b-48e0-bce7-3d02e5352306" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-5602254d-969e-4759-94a0-91de361c9a9c" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-5602254d-969e-4759-94a0-91de361c9a9c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot 5602254d-969e-4759-94a0-91de361c9a9c of volume 770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66aeac-d6e9-4d45-8e65-0e59c1ddc28e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:42 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c Nov 06 21:37:42 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:42 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c" returned: 0 in 0.358s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770d5edd-844b-48e0-bce7-3d02e5352306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae4adf-62c9-4522-b502-f97f9cfb16ac]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:42 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 Nov 06 21:37:42 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:42 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:43 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c Nov 06 21:37:43 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:43 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c" returned: 0 in 0.332s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:43 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c Nov 06 21:37:43 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:43 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306.5602254d-969e-4759-94a0-91de361c9a9c" returned: 0 in 0.253s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-5602254d-969e-4759-94a0-91de361c9a9c" released by "_delete_snapshot" :: held 1.389s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-770d5edd-844b-48e0-bce7-3d02e5352306" released by "delete_snapshot" :: held 1.411s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Created reservations ['d1b5079c-c3de-4590-8d73-1c84556fa17d', '70be9bfc-34cb-4a89-857d-6bf4cd7cbd97', '4a540164-d8d9-4f57-a56a-3eeff179855a', 'ed5ee01e-caa3-4dca-9971-ab62365372fb'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:43 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:37:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d69b4c2c-8fe8-43db-bd06-cd8892913af0 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-5602254d-969e-4759-94a0-91de361c9a9c-delete_snapshot" released by "delete_snapshot" :: held 1.541s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-770d5edd-844b-48e0-bce7-3d02e5352306-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-770d5edd-844b-48e0-bce7-3d02e5352306-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-770d5edd-844b-48e0-bce7-3d02e5352306" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-770d5edd-844b-48e0-bce7-3d02e5352306" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cad6da-df4f-45f3-906e-3434a2c8ed7a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:44 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 Nov 06 21:37:44 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:44 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:44 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306 Nov 06 21:37:44 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:45 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-770d5edd-844b-48e0-bce7-3d02e5352306" returned: 0 in 0.238s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-770d5edd-844b-48e0-bce7-3d02e5352306" released by "delete_volume" :: held 0.651s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Created reservations ['208b7ca8-11ff-4355-b889-a92491994b24', '7ae29c4c-aa59-42ac-b782-a3fbb4345677', '0e69009e-449f-476d-8aef-e0dac0da733c', '6b991c57-2462-434d-83bb-60d542f2247f'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:45 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:45 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:45 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.287s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:45 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5e595019-4419-481b-8693-4f8ed0f43f73 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-770d5edd-844b-48e0-bce7-3d02e5352306-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (7ebd3a8a-0f67-4b2c-9321-f6703a2522b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa6191b-e985-4ffe-988a-cd16314d2ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa6191b-e985-4ffe-988a-cd16314d2ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122337456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d42130-d800-460c-ab7a-12a0231241dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:46Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c22da4-2a13-491e-8382-d129ab53b310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c22da4-2a13-491e-8382-d129ab53b310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c8891-38da-4b21-8dbd-49463120b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c8891-38da-4b21-8dbd-49463120b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d42130-d800-460c-ab7a-12a0231241dd', 'volume_name': 'volume-b1d42130-d800-460c-ab7a-12a0231241dd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0ca9b2-62eb-4445-8c26-611f4b273459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0ca9b2-62eb-4445-8c26-611f4b273459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ed8f0e-5a26-46d3-bc9c-d2897d060729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:45 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Volume b1d42130-d800-460c-ab7a-12a0231241dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d42130-d800-460c-ab7a-12a0231241dd', 'volume_size': 1} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122337456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d42130-d800-460c-ab7a-12a0231241dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:46Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Creating volume b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:45 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:46 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:46 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd 1073741824 Nov 06 21:37:46 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:46 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd 1073741824" returned: 0 in 0.448s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:46 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd Nov 06 21:37:46 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:46 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd" returned: 0 in 0.262s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ed8f0e-5a26-46d3-bc9c-d2897d060729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d42130-d800-460c-ab7a-12a0231241dd', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17b1947-8b6f-4c3c-b3f3-557417d5c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:46 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Volume volume-b1d42130-d800-460c-ab7a-12a0231241dd (b1d42130-d800-460c-ab7a-12a0231241dd): created successfully Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17b1947-8b6f-4c3c-b3f3-557417d5c85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (7ebd3a8a-0f67-4b2c-9321-f6703a2522b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ea08609f-3188-4da0-a96f-e3f7abd4cebe tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot a5bb6275-29ad-470f-9d2f-f7896b37ab5f of volume b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea4454-b8f4-4621-9735-873e2703214c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:47 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd Nov 06 21:37:47 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:47 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd" returned: 0 in 0.353s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:47 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f 1G Nov 06 21:37:47 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:47 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f 1G" returned: 0 in 0.441s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d42130-d800-460c-ab7a-12a0231241dd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:47 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d42130-d800-460c-ab7a-12a0231241dd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f Nov 06 21:37:47 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d42130-d800-460c-ab7a-12a0231241dd -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f" returned: 0 in 0.313s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f is being set with open permissions: ugo+rw Nov 06 21:37:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f Nov 06 21:37:48 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f" returned: 0 in 0.275s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.info Nov 06 21:37:48 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.info" returned: 0 in 0.285s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.info is being set with open permissions: ugo+rw Nov 06 21:37:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.info Nov 06 21:37:48 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:49 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.info" returned: 0 in 0.253s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:49 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-83b3c8a6-ca82-4d58-a8d7-d08b4d9447b8 tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-a5bb6275-29ad-470f-9d2f-f7896b37ab5f-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Lock "cinder-a5bb6275-29ad-470f-9d2f-f7896b37ab5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-b1d42130-d800-460c-ab7a-12a0231241dd" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-b1d42130-d800-460c-ab7a-12a0231241dd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-a5bb6275-29ad-470f-9d2f-f7896b37ab5f" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a5bb6275-29ad-470f-9d2f-f7896b37ab5f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot a5bb6275-29ad-470f-9d2f-f7896b37ab5f of volume b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eb1464-1169-4118-aec7-90217efba5d4]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:50 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f Nov 06 21:37:50 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:50 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d42130-d800-460c-ab7a-12a0231241dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8cbeb9-003f-4189-b03b-25acb7a9984a]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:50 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd Nov 06 21:37:50 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:51 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd" returned: 0 in 0.346s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:51 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f Nov 06 21:37:51 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:51 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:51 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f Nov 06 21:37:51 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:51 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd.a5bb6275-29ad-470f-9d2f-f7896b37ab5f" returned: 0 in 0.259s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-a5bb6275-29ad-470f-9d2f-f7896b37ab5f" released by "_delete_snapshot" :: held 1.447s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-b1d42130-d800-460c-ab7a-12a0231241dd" released by "delete_snapshot" :: held 1.470s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Created reservations ['8fc13e48-f1e5-4bf3-8c25-1e54e2b56181', 'cadc607b-d436-412f-98f4-4a78f184f455', '3c490a8c-9b9e-407e-a978-067328a1e263', '91b20aa3-050b-405d-b129-d6fafe32daef'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:37:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-9adfb8ba-eceb-41c5-af67-d308ed3d7eaf tempest-ProjectMemberTests-1866665000 None] Lock "cinder-a5bb6275-29ad-470f-9d2f-f7896b37ab5f-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-b1d42130-d800-460c-ab7a-12a0231241dd-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Lock "cinder-b1d42130-d800-460c-ab7a-12a0231241dd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-b1d42130-d800-460c-ab7a-12a0231241dd" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-b1d42130-d800-460c-ab7a-12a0231241dd" acquired by "delete_volume" :: waited 0.019s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b42c4c-9c90-43b4-82b2-8acc533c6805]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:52 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd Nov 06 21:37:52 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd" returned: 0 in 0.379s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:52 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd Nov 06 21:37:52 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:53 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-b1d42130-d800-460c-ab7a-12a0231241dd" returned: 0 in 0.268s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-b1d42130-d800-460c-ab7a-12a0231241dd" released by "delete_volume" :: held 0.714s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Created reservations ['8c79b449-ea6e-4f0e-8e04-f86c4fbe1543', '737ac11c-9a94-48a6-a036-e6077f45ebc6', '9a0f405f-5834-4d91-a72c-68ae7c458767', 'bbe7d13f-a582-4be8-9a67-aa3052bc5b5b'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:53 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:37:53 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:53 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.287s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:37:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-5a72d4ed-f28b-4e53-bd2d-df222c19e7ac tempest-ProjectMemberTests-1866665000 None] Lock "cinder-b1d42130-d800-460c-ab7a-12a0231241dd-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (733ec3fc-1303-4739-8b58-940f7090886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf218a5-3671-4894-833c-71bb6a2c0f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf218a5-3671-4894-833c-71bb6a2c0f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577049954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906b83a0-e40a-4b70-a0e1-b6b89de0e87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:54Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6252a211-f8c9-4ffa-a429-6e7f0ab1faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6252a211-f8c9-4ffa-a429-6e7f0ab1faaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff485a79-5101-4c3d-9c56-4668d141a8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff485a79-5101-4c3d-9c56-4668d141a8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906b83a0-e40a-4b70-a0e1-b6b89de0e87c', 'volume_name': 'volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95504d2d-5bb4-42a1-a787-ce0421ff0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95504d2d-5bb4-42a1-a787-ce0421ff0f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec3709f-7637-45eb-b460-8224682e2aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:54 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Volume 906b83a0-e40a-4b70-a0e1-b6b89de0e87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c', 'volume_size': 1} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577049954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906b83a0-e40a-4b70-a0e1-b6b89de0e87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:54Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Creating volume 906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:54 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:54 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c 1073741824 Nov 06 21:37:54 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:54 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c 1073741824" returned: 0 in 0.422s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:54 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c Nov 06 21:37:54 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:54 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec3709f-7637-45eb-b460-8224682e2aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4923993d-e5a0-4c68-8d6f-2f743510ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:54 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Volume volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c (906b83a0-e40a-4b70-a0e1-b6b89de0e87c): created successfully Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4923993d-e5a0-4c68-8d6f-2f743510ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (733ec3fc-1303-4739-8b58-940f7090886b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:54 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-6f66639a-22b4-4662-be74-15963824a3a8 tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:37:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot 351d277e-d754-4b91-9fa6-895d1c0b8b81 of volume 906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:55 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[057b76be-145a-4ef5-a788-992849b6e5aa]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c Nov 06 21:37:55 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:55 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" returned: 0 in 0.378s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 1G Nov 06 21:37:55 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 1G" returned: 0 in 0.436s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:56 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 Nov 06 21:37:56 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81" returned: 0 in 0.310s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 is being set with open permissions: ugo+rw Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:56 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 Nov 06 21:37:56 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:56 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.info Nov 06 21:37:56 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.info" returned: 0 in 0.285s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.info is being set with open permissions: ugo+rw Nov 06 21:37:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:56 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.info Nov 06 21:37:56 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:57 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.info" returned: 0 in 0.241s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:57 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ef75c719-549c-4e87-838e-44f4bcd01233 tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-351d277e-d754-4b91-9fa6-895d1c0b8b81-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-351d277e-d754-4b91-9fa6-895d1c0b8b81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-351d277e-d754-4b91-9fa6-895d1c0b8b81" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-351d277e-d754-4b91-9fa6-895d1c0b8b81" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot 351d277e-d754-4b91-9fa6-895d1c0b8b81 of volume 906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d6940-c1b7-4832-8def-6b60b5392771]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:57 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 Nov 06 21:37:57 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:57 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0449a7e2-de33-4efd-ae18-eca4ef9bcc4f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:57 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c Nov 06 21:37:57 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:58 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:58 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 Nov 06 21:37:58 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:58 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:58 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81 Nov 06 21:37:58 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:58 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c.351d277e-d754-4b91-9fa6-895d1c0b8b81" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-351d277e-d754-4b91-9fa6-895d1c0b8b81" released by "_delete_snapshot" :: held 1.447s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" released by "delete_snapshot" :: held 1.469s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:58 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Created reservations ['774dce7b-e27a-40a7-b474-5fc9b4624df6', '978ccf2d-6cd3-4bf0-b145-94f36e6010be', '1d296750-0c0b-4709-a723-d2c5b462ae5e', '2b1724df-e5c9-43db-a898-6d02c9f75b70'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:59 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:37:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-ae53a91f-adbb-4efe-b6aa-97790377a66b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-351d277e-d754-4b91-9fa6-895d1c0b8b81-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-906b83a0-e40a-4b70-a0e1-b6b89de0e87c-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-906b83a0-e40a-4b70-a0e1-b6b89de0e87c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" acquired by "delete_volume" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:59 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd522a-46cb-4427-bccd-daf5f3b70b99]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:59 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c Nov 06 21:37:59 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:00 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" returned: 0 in 0.359s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:00 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c Nov 06 21:38:00 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:00 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" returned: 0 in 0.239s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-906b83a0-e40a-4b70-a0e1-b6b89de0e87c" released by "delete_volume" :: held 0.662s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Created reservations ['80caf44e-37dd-4e59-a0c8-1ed6b5258801', '43ce6e18-83fe-49e8-bbb8-26fbc0d04b6c', '967b24c3-10fc-45df-b183-f17619d1601e', '28f52fe0-5fa1-4083-becf-41b336c78193'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:00 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:00 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:00 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.234s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:38:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-bf85f80c-eeaf-4aa1-95d4-03824736c410 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-906b83a0-e40a-4b70-a0e1-b6b89de0e87c-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (a65c1bdc-651a-4705-b3fd-873709924a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a54e99-ed9b-49fc-8def-a2a2323de41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a54e99-ed9b-49fc-8def-a2a2323de41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532596437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c16369b-7ca8-47eb-8d5f-e575c60abe61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:01Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12688de9-09d3-4c0f-ae4a-a8027d0543db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12688de9-09d3-4c0f-ae4a-a8027d0543db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a1cf92-219c-4c23-9c97-775b2b3ff907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a1cf92-219c-4c23-9c97-775b2b3ff907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c16369b-7ca8-47eb-8d5f-e575c60abe61', 'volume_name': 'volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd22a61-94ba-4bbb-84ad-c9a877bc4418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd22a61-94ba-4bbb-84ad-c9a877bc4418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0609909c-902e-49fb-8188-30dc341ff951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:01 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Volume 6c16369b-7ca8-47eb-8d5f-e575c60abe61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61', 'volume_size': 1} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532596437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c16369b-7ca8-47eb-8d5f-e575c60abe61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:01Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Creating volume 6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:01 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:01 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 1073741824 Nov 06 21:38:01 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:01 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 1073741824" returned: 0 in 0.461s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:01 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 Nov 06 21:38:01 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:01 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61" returned: 0 in 0.255s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0609909c-902e-49fb-8188-30dc341ff951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:01 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129445a5-7636-407f-b2ac-5a29a48cce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:02 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Volume volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 (6c16369b-7ca8-47eb-8d5f-e575c60abe61): created successfully Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129445a5-7636-407f-b2ac-5a29a48cce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (a65c1bdc-651a-4705-b3fd-873709924a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:02 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-de3faf6f-ae79-463c-93f0-5f9e69722413 tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot 6672901f-4759-4562-ade5-49ad4b976dc9 of volume 6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5309221d-94f6-4015-ae3a-d9de4eb69f0f]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:02 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 Nov 06 21:38:02 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:02 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61" returned: 0 in 0.352s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:02 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:02 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 1G Nov 06 21:38:02 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:03 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 1G" returned: 0 in 0.384s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:03 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 Nov 06 21:38:03 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:03 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9" returned: 0 in 0.295s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:03 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 is being set with open permissions: ugo+rw Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:03 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 Nov 06 21:38:03 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:03 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9" returned: 0 in 0.246s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=141,cinder:INSERT=52,cinder:UPDATE=192,cinder:DELETE=18 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:03 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.info Nov 06 21:38:03 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:03 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.info" returned: 0 in 0.249s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:03 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.info is being set with open permissions: ugo+rw Nov 06 21:38:03 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:03 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.info Nov 06 21:38:03 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:04 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.info" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:UPDATE=179,cinder:SELECT=146,cinder:DELETE=14,cinder:INSERT=45 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:04 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-81d23e93-a913-40d1-8265-6496721fce60 tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-6672901f-4759-4562-ade5-49ad4b976dc9-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-6672901f-4759-4562-ade5-49ad4b976dc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-6c16369b-7ca8-47eb-8d5f-e575c60abe61" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-6c16369b-7ca8-47eb-8d5f-e575c60abe61" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-6672901f-4759-4562-ade5-49ad4b976dc9" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-6672901f-4759-4562-ade5-49ad4b976dc9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot 6672901f-4759-4562-ade5-49ad4b976dc9 of volume 6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[17939b04-3360-40c7-8f46-1f767634c839]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:04 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 Nov 06 21:38:04 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:04 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf47359-95aa-4a48-aa9e-328738cee092]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:04 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:04 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 Nov 06 21:38:04 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:05 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61" returned: 0 in 0.340s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:05 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 Nov 06 21:38:05 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:05 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9" returned: 0 in 0.329s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:05 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9 Nov 06 21:38:05 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:05 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61.6672901f-4759-4562-ade5-49ad4b976dc9" returned: 0 in 0.244s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-6672901f-4759-4562-ade5-49ad4b976dc9" released by "_delete_snapshot" :: held 1.357s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-6c16369b-7ca8-47eb-8d5f-e575c60abe61" released by "delete_snapshot" :: held 1.379s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Created reservations ['92498e42-6e39-4243-a904-e98aef37828f', '57b3a326-652a-48c1-9b0f-d82b5f841753', '0e8db038-960b-4585-8e91-7f6428fc7e6a', 'e5359d82-ef0f-4768-b0c4-ed7b4b7019d7'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:05 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:38:05 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-4f8d9729-7bdf-422d-a883-850f074e9b02 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-6672901f-4759-4562-ade5-49ad4b976dc9-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-6c16369b-7ca8-47eb-8d5f-e575c60abe61-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-6c16369b-7ca8-47eb-8d5f-e575c60abe61-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-6c16369b-7ca8-47eb-8d5f-e575c60abe61" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:06 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-6c16369b-7ca8-47eb-8d5f-e575c60abe61" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:06 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25f8e66-e5b2-47cb-a89d-d504eaec69ca]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:06 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:06 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 Nov 06 21:38:06 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:07 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61" returned: 0 in 0.354s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:07 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61 Nov 06 21:38:07 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:07 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-6c16369b-7ca8-47eb-8d5f-e575c60abe61" returned: 0 in 0.252s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-6c16369b-7ca8-47eb-8d5f-e575c60abe61" released by "delete_volume" :: held 0.666s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Created reservations ['df00b816-f3e3-46bf-bb5a-af6f8a167994', '382f76e1-2877-4761-9042-876a68be823b', '209ccb05-03cf-4009-9e4b-46cb5012435d', 'b1715b49-8acd-4a23-99eb-0626b370e360'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:07 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:07 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:07 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.258s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:07 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:38:07 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b5be996a-3826-488a-860f-a90df3e49856 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-6c16369b-7ca8-47eb-8d5f-e575c60abe61-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (f4e68430-51b5-419b-8a2f-b2c9baa7f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c6321-2155-4b5c-92a8-6874d1fdd036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c6321-2155-4b5c-92a8-6874d1fdd036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004856732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68626479-d7ed-4fa3-9145-380596015b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:08Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944816ec-dc77-4833-99bd-239c99299164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944816ec-dc77-4833-99bd-239c99299164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613ce360-b093-4106-aa59-f016d039878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613ce360-b093-4106-aa59-f016d039878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68626479-d7ed-4fa3-9145-380596015b16', 'volume_name': 'volume-68626479-d7ed-4fa3-9145-380596015b16', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066a4090-2ea9-4054-a282-312623481aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066a4090-2ea9-4054-a282-312623481aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fdfae9-21aa-486b-b340-428a94816f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:08 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Volume 68626479-d7ed-4fa3-9145-380596015b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68626479-d7ed-4fa3-9145-380596015b16', 'volume_size': 1} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004856732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68626479-d7ed-4fa3-9145-380596015b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:08Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Creating volume 68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:08 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:08 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 1073741824 Nov 06 21:38:08 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:08 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 1073741824" returned: 0 in 0.409s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:08 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 Nov 06 21:38:08 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:08 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16" returned: 0 in 0.244s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fdfae9-21aa-486b-b340-428a94816f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68626479-d7ed-4fa3-9145-380596015b16', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd0bdf-13be-4708-a8d4-7e7db26f7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:08 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Volume volume-68626479-d7ed-4fa3-9145-380596015b16 (68626479-d7ed-4fa3-9145-380596015b16): created successfully Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd0bdf-13be-4708-a8d4-7e7db26f7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:08 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (f4e68430-51b5-419b-8a2f-b2c9baa7f10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:08 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-27875963-b7d3-45dd-82ec-50ead1d783e1 tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:38:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:09 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot 72651565-574c-4026-99e7-5d025984750c of volume 68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:09 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3c62b-af61-4f64-8021-e02ec4cea800]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:09 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 Nov 06 21:38:09 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:09 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:09 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:09 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c 1G Nov 06 21:38:09 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:10 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c 1G" returned: 0 in 0.380s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68626479-d7ed-4fa3-9145-380596015b16 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:10 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68626479-d7ed-4fa3-9145-380596015b16 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c Nov 06 21:38:10 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:10 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68626479-d7ed-4fa3-9145-380596015b16 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c" returned: 0 in 0.287s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:10 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c is being set with open permissions: ugo+rw Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:10 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c Nov 06 21:38:10 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:10 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c" returned: 0 in 0.235s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:10 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.info Nov 06 21:38:10 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:10 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.info" returned: 0 in 0.241s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:10 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.info is being set with open permissions: ugo+rw Nov 06 21:38:10 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:10 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.info Nov 06 21:38:10 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:11 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.info" returned: 0 in 0.236s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:11 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-3d777231-d181-45c3-bdd5-19daa34eb42b tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:38:11 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:11 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:11 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.254s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-72651565-574c-4026-99e7-5d025984750c-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-72651565-574c-4026-99e7-5d025984750c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-68626479-d7ed-4fa3-9145-380596015b16" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-68626479-d7ed-4fa3-9145-380596015b16" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-72651565-574c-4026-99e7-5d025984750c" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-72651565-574c-4026-99e7-5d025984750c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot 72651565-574c-4026-99e7-5d025984750c of volume 68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa1d6a6-5ccb-4d8a-885b-3bd079a03725]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:11 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c Nov 06 21:38:11 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:11 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c" returned: 0 in 0.362s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68626479-d7ed-4fa3-9145-380596015b16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbfc135-3ca1-49e1-9660-0e0e68f5a9ec]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:12 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 Nov 06 21:38:12 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:12 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:12 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c Nov 06 21:38:12 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:12 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c" returned: 0 in 0.335s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:12 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c Nov 06 21:38:12 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:12 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16.72651565-574c-4026-99e7-5d025984750c" returned: 0 in 0.253s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-72651565-574c-4026-99e7-5d025984750c" released by "_delete_snapshot" :: held 1.402s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-68626479-d7ed-4fa3-9145-380596015b16" released by "delete_snapshot" :: held 1.426s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:12 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Created reservations ['ba66a800-cb99-4fea-96fb-73120ced8a1d', 'db5f8bbb-55ed-41a4-b2b0-187b7a18d3f5', '623b8537-8eaa-4f16-a04b-c8c629354152', 'a6321f52-4a0d-4bf3-82be-93f2926e52b1'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:13 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:38:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-35124e3c-eda2-4aae-ba11-8c58a7a9c9a4 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-72651565-574c-4026-99e7-5d025984750c-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-68626479-d7ed-4fa3-9145-380596015b16-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-68626479-d7ed-4fa3-9145-380596015b16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-68626479-d7ed-4fa3-9145-380596015b16" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:13 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-68626479-d7ed-4fa3-9145-380596015b16" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:13 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[45de44d3-a201-40a6-b744-9bed8904c1c0]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:13 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:13 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 Nov 06 21:38:13 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:14 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:14 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16 Nov 06 21:38:14 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:14 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-68626479-d7ed-4fa3-9145-380596015b16" returned: 0 in 0.244s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-68626479-d7ed-4fa3-9145-380596015b16" released by "delete_volume" :: held 0.652s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Created reservations ['e2793cec-ae16-4a7d-bde8-25f498a7e73d', '5de5b285-bf79-4559-88a0-bf3fae8471ac', '86a49b30-f796-4982-8fd4-c27ec2e0f452', 'cf170f9b-b415-4be9-bb3d-91b6245a27f3'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:14 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:14 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:14 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.255s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:14 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:38:14 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1a13e61c-6da6-4c01-8543-f52fc5d48471 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-68626479-d7ed-4fa3-9145-380596015b16-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (2972027d-7260-4a43-864c-91e5eb0d3cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a8b9e-96de-49ef-a8a0-98b49f341857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a8b9e-96de-49ef-a8a0-98b49f341857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1239144954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dcc1c1-faef-413e-b406-d83bd771e977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:15Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7d89fe-4b98-4eb3-b923-4dfe4c1b60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7d89fe-4b98-4eb3-b923-4dfe4c1b60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770f62ab-180b-4567-9be5-ff57ba938360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770f62ab-180b-4567-9be5-ff57ba938360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04dcc1c1-faef-413e-b406-d83bd771e977', 'volume_name': 'volume-04dcc1c1-faef-413e-b406-d83bd771e977', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a7e2f7-b2dd-4d17-901b-51f8b9a128d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a7e2f7-b2dd-4d17-901b-51f8b9a128d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f453a8e6-13ed-4f1e-9df7-013f3198b853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Volume 04dcc1c1-faef-413e-b406-d83bd771e977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04dcc1c1-faef-413e-b406-d83bd771e977', 'volume_size': 1} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1239144954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dcc1c1-faef-413e-b406-d83bd771e977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c7676bf80c4f71a2924ba4bbbd1fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:15Z,use_quota=True,user_id='df2b71979df74d5fb5ecce99a8058afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Creating volume 04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:15 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:15 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 1073741824 Nov 06 21:38:15 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:15 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 1073741824" returned: 0 in 0.424s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:15 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:15 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 Nov 06 21:38:15 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:16 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f453a8e6-13ed-4f1e-9df7-013f3198b853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04dcc1c1-faef-413e-b406-d83bd771e977', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03e4d03-bfbc-4772-9984-f120fe64037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:16 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Volume volume-04dcc1c1-faef-413e-b406-d83bd771e977 (04dcc1c1-faef-413e-b406-d83bd771e977): created successfully Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03e4d03-bfbc-4772-9984-f120fe64037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Flow 'volume_create_manager' (2972027d-7260-4a43-864c-91e5eb0d3cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:16 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e51fcb04-43e0-4fd6-b375-92d1e27092ba tempest-ProjectMemberTests-1866665000 None] Created volume successfully. Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Creating offline snapshot 9af49a02-271d-4822-8893-4d820b34f0ed of volume 04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a40af3b-8875-4ab1-bd5e-21776caee797]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:16 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 Nov 06 21:38:16 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:16 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977" returned: 0 in 0.371s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:16 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:16 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed 1G Nov 06 21:38:16 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:17 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed 1G" returned: 0 in 0.402s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04dcc1c1-faef-413e-b406-d83bd771e977 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:17 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04dcc1c1-faef-413e-b406-d83bd771e977 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed Nov 06 21:38:17 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:17 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04dcc1c1-faef-413e-b406-d83bd771e977 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed" returned: 0 in 0.291s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:17 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed is being set with open permissions: ugo+rw Nov 06 21:38:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:17 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed Nov 06 21:38:17 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:17 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed" returned: 0 in 0.253s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:17 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:17 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.info Nov 06 21:38:17 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:18 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.info" returned: 0 in 0.242s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:18 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.info is being set with open permissions: ugo+rw Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:18 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.info Nov 06 21:38:18 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:18 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.info" returned: 0 in 0.234s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:18 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0e227e7c-3ad2-4b5d-a733-2b60af5aee21 tempest-ProjectMemberTests-1866665000 None] Create snapshot completed successfully Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-9af49a02-271d-4822-8893-4d820b34f0ed-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-9af49a02-271d-4822-8893-4d820b34f0ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-04dcc1c1-faef-413e-b406-d83bd771e977" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-04dcc1c1-faef-413e-b406-d83bd771e977" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-9af49a02-271d-4822-8893-4d820b34f0ed" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-9af49a02-271d-4822-8893-4d820b34f0ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Deleting offline snapshot 9af49a02-271d-4822-8893-4d820b34f0ed of volume 04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] snapshot_file for this snap is: volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68ba375-88bf-4d3d-9b38-1a7955a7e8ee]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:18 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:18 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed Nov 06 21:38:18 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:19 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed" returned: 0 in 0.356s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04dcc1c1-faef-413e-b406-d83bd771e977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[db898647-f4be-4de4-b137-93c0902db2cb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:19 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 Nov 06 21:38:19 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:19 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977" returned: 0 in 0.361s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:19 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed Nov 06 21:38:19 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:19 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed" returned: 0 in 0.334s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:19 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:19 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed Nov 06 21:38:19 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:20 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977.9af49a02-271d-4822-8893-4d820b34f0ed" returned: 0 in 0.261s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-9af49a02-271d-4822-8893-4d820b34f0ed" released by "_delete_snapshot" :: held 1.411s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-04dcc1c1-faef-413e-b406-d83bd771e977" released by "delete_snapshot" :: held 1.434s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Created reservations ['fad6e4d1-519b-4f5f-ade4-2789f2fd32fd', 'a4bb3e8e-1e94-490e-bcbc-97eb4034d867', 'dd3c1895-dc83-4905-8b69-b258b52651a0', '87a09abf-6c2e-4bb6-9f20-2469423437f6'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:20 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Delete snapshot completed successfully. Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d626eeaf-125f-43e3-a218-11612c3b4d2b tempest-ProjectMemberTests-1866665000 None] Lock "cinder-9af49a02-271d-4822-8893-4d820b34f0ed-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-04dcc1c1-faef-413e-b406-d83bd771e977-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-04dcc1c1-faef-413e-b406-d83bd771e977-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "cinder-quobyte-04dcc1c1-faef-413e-b406-d83bd771e977" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-04dcc1c1-faef-413e-b406-d83bd771e977" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[265a94db-4f66-4f0c-83c3-594eed5517a7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:20 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:21 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 Nov 06 21:38:21 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:21 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977" returned: 0 in 0.359s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:21 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977 Nov 06 21:38:21 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:21 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-04dcc1c1-faef-413e-b406-d83bd771e977" returned: 0 in 0.239s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-quobyte-04dcc1c1-faef-413e-b406-d83bd771e977" released by "delete_volume" :: held 0.656s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Created reservations ['2abacc95-fa8f-4e92-890c-0d4556cd945b', '15a93080-cc07-4ce6-b3a7-a552cb485393', '68096b73-eac1-44cc-99a7-9004d0f5cf43', 'b589f897-59b0-40f3-ac07-c58e5d63d62d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:21 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:21 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:21 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.253s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:21 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Deleted volume successfully. Nov 06 21:38:21 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-40760639-2e86-4a1c-bd94-454455c00147 tempest-ProjectMemberTests-1866665000 None] Lock "cinder-04dcc1c1-faef-413e-b406-d83bd771e977-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (ad4b5caf-3a01-465b-b842-f962a4c79685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f319cb18-9e34-4287-8102-f9c0eedae299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f319cb18-9e34-4287-8102-f9c0eedae299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1617757943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371f708a-c372-4a55-a21e-7dcb026abb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:26Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a41810b-f0b1-4c28-b65c-648b33e2769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a41810b-f0b1-4c28-b65c-648b33e2769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f710f19c-ee9c-4e3c-a836-6baf7fb60a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f710f19c-ee9c-4e3c-a836-6baf7fb60a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371f708a-c372-4a55-a21e-7dcb026abb34', 'volume_name': 'volume-371f708a-c372-4a55-a21e-7dcb026abb34', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c5fbb2-11ab-4162-9929-9d342ea3429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c5fbb2-11ab-4162-9929-9d342ea3429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec7c276-6bb2-4caa-b27f-b7f552b8f26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:25 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Volume 371f708a-c372-4a55-a21e-7dcb026abb34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371f708a-c372-4a55-a21e-7dcb026abb34', 'volume_size': 1} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1617757943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371f708a-c372-4a55-a21e-7dcb026abb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:26Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Creating volume 371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:25 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:25 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:25 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 1073741824 Nov 06 21:38:25 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:26 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 1073741824" returned: 0 in 0.395s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:26 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 Nov 06 21:38:26 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:26 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34" returned: 0 in 0.248s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec7c276-6bb2-4caa-b27f-b7f552b8f26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371f708a-c372-4a55-a21e-7dcb026abb34', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948e6942-82e7-4bde-8dc0-9730bf94b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:26 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Volume volume-371f708a-c372-4a55-a21e-7dcb026abb34 (371f708a-c372-4a55-a21e-7dcb026abb34): created successfully Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948e6942-82e7-4bde-8dc0-9730bf94b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (ad4b5caf-3a01-465b-b842-f962a4c79685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:26 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-0c99d168-1b02-4733-9d65-ae259f50b948 tempest-ProjectReaderTests-999922982 None] Created volume successfully. Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Creating offline snapshot 653daedb-68f1-451b-b597-5aff5f323187 of volume 371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b82184-34f4-4383-97ba-b2a345160ac8]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:26 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:26 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 Nov 06 21:38:26 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:27 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34" returned: 0 in 0.361s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:27 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 1G Nov 06 21:38:27 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:27 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 1G" returned: 0 in 0.410s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371f708a-c372-4a55-a21e-7dcb026abb34 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:27 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371f708a-c372-4a55-a21e-7dcb026abb34 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 Nov 06 21:38:27 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:27 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371f708a-c372-4a55-a21e-7dcb026abb34 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187" returned: 0 in 0.306s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:27 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 is being set with open permissions: ugo+rw Nov 06 21:38:27 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:27 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 Nov 06 21:38:27 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:28 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187" returned: 0 in 0.239s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:28 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.info Nov 06 21:38:28 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:28 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.info" returned: 0 in 0.244s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:28 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.info is being set with open permissions: ugo+rw Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:28 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.info Nov 06 21:38:28 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:28 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.info" returned: 0 in 0.248s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:28 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-f9fbe8b8-0192-4de3-a5b4-41b863fb3317 tempest-ProjectReaderTests-999922982 None] Create snapshot completed successfully Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-653daedb-68f1-451b-b597-5aff5f323187-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-653daedb-68f1-451b-b597-5aff5f323187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-371f708a-c372-4a55-a21e-7dcb026abb34" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-371f708a-c372-4a55-a21e-7dcb026abb34" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:28 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-653daedb-68f1-451b-b597-5aff5f323187" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-653daedb-68f1-451b-b597-5aff5f323187" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Deleting offline snapshot 653daedb-68f1-451b-b597-5aff5f323187 of volume 371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] snapshot_file for this snap is: volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c1503-75a0-48fa-9374-e472acc940cc]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:29 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 Nov 06 21:38:29 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:29 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371f708a-c372-4a55-a21e-7dcb026abb34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[42739720-430c-419c-8b19-a74247357966]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:29 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 Nov 06 21:38:29 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:29 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34" returned: 0 in 0.349s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:29 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:29 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 Nov 06 21:38:29 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:30 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187" returned: 0 in 0.327s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:30 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187 Nov 06 21:38:30 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:30 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:30 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34.653daedb-68f1-451b-b597-5aff5f323187" returned: 0 in 0.239s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-653daedb-68f1-451b-b597-5aff5f323187" released by "_delete_snapshot" :: held 1.374s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-371f708a-c372-4a55-a21e-7dcb026abb34" released by "delete_snapshot" :: held 1.396s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:30 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Created reservations ['931f7f4d-a78e-4ff2-80bb-45a95d684050', 'e298dc1c-8a69-482a-90b6-212e8c306be5', '55ee4603-61a4-44ba-80c4-fbdd119fa853', '99296b58-7f0d-46be-9885-a3ad35103cd4'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:30 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Delete snapshot completed successfully. Nov 06 21:38:30 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-d330f938-67c0-40c2-b801-b45c2ef35ea1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-653daedb-68f1-451b-b597-5aff5f323187-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-371f708a-c372-4a55-a21e-7dcb026abb34-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Lock "cinder-371f708a-c372-4a55-a21e-7dcb026abb34-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-371f708a-c372-4a55-a21e-7dcb026abb34" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-371f708a-c372-4a55-a21e-7dcb026abb34" acquired by "delete_volume" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a311c9b8-9d97-4a18-97ca-5f2996ce5b53]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:31 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 Nov 06 21:38:31 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:31 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34" returned: 0 in 0.379s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:31 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34 Nov 06 21:38:31 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:31 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-371f708a-c372-4a55-a21e-7dcb026abb34" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-371f708a-c372-4a55-a21e-7dcb026abb34" released by "delete_volume" :: held 0.689s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Created reservations ['381375c9-0c67-4a4a-b7af-7ebae07d66e1', '967a7c2f-e99e-4b17-a3b1-0acbefd77406', 'fe0341ab-268b-4406-8820-82dc92c3d59b', '30e42efc-d46d-4741-af97-42b69bec387a'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:31 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:31 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:31 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:32 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.252s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:32 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Deleted volume successfully. Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-232cb5df-9d67-4b18-9098-a6f222c6c43b tempest-ProjectReaderTests-999922982 None] Lock "cinder-371f708a-c372-4a55-a21e-7dcb026abb34-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (b4d50ee4-fc02-4a91-ac2e-107fc816790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233b19af-b504-4f24-8c3c-129462d984fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233b19af-b504-4f24-8c3c-129462d984fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808163746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef604170-f836-4cf1-a141-9814dc14f809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:33Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d4fed8-5154-415f-82ee-f5b7801b58f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d4fed8-5154-415f-82ee-f5b7801b58f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c789f496-b82b-4dab-9b24-037064b8b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c789f496-b82b-4dab-9b24-037064b8b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef604170-f836-4cf1-a141-9814dc14f809', 'volume_name': 'volume-ef604170-f836-4cf1-a141-9814dc14f809', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853804f4-23c4-42b9-ac01-af9159816241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853804f4-23c4-42b9-ac01-af9159816241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b871b1-c59c-4e9c-969c-078b35460116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:32 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Volume ef604170-f836-4cf1-a141-9814dc14f809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef604170-f836-4cf1-a141-9814dc14f809', 'volume_size': 1} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808163746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef604170-f836-4cf1-a141-9814dc14f809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:33Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Creating volume ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:32 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:32 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:32 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 1073741824 Nov 06 21:38:32 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:33 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 1073741824" returned: 0 in 0.409s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:33 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 Nov 06 21:38:33 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:33 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809" returned: 0 in 0.256s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b871b1-c59c-4e9c-969c-078b35460116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef604170-f836-4cf1-a141-9814dc14f809', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd26afa-5616-4c10-a5e4-6065aa3a4054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:33 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Volume volume-ef604170-f836-4cf1-a141-9814dc14f809 (ef604170-f836-4cf1-a141-9814dc14f809): created successfully Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd26afa-5616-4c10-a5e4-6065aa3a4054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (b4d50ee4-fc02-4a91-ac2e-107fc816790d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:33 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-685bb111-8b29-4226-906b-36af1a1cdf03 tempest-ProjectReaderTests-999922982 None] Created volume successfully. Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Creating offline snapshot da329fb5-be5f-4f95-a67a-3d49ae4e9496 of volume ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d66acd-e3b8-4ba6-8c32-4b4fd82a8f75]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:33 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:34 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 Nov 06 21:38:34 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:34 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809" returned: 0 in 0.364s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:34 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 1G Nov 06 21:38:34 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:34 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 1G" returned: 0 in 0.422s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef604170-f836-4cf1-a141-9814dc14f809 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:34 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef604170-f836-4cf1-a141-9814dc14f809 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 Nov 06 21:38:34 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:34 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef604170-f836-4cf1-a141-9814dc14f809 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496" returned: 0 in 0.292s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:34 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 is being set with open permissions: ugo+rw Nov 06 21:38:34 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:35 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 Nov 06 21:38:35 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:35 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496" returned: 0 in 0.254s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:35 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.info Nov 06 21:38:35 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:35 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.info" returned: 0 in 0.250s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:35 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.info is being set with open permissions: ugo+rw Nov 06 21:38:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:35 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.info Nov 06 21:38:35 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:35 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.info" returned: 0 in 0.260s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:35 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:35 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-379bb76b-78e3-4395-aa0d-474c4b86382f tempest-ProjectReaderTests-999922982 None] Create snapshot completed successfully Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-da329fb5-be5f-4f95-a67a-3d49ae4e9496-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Lock "cinder-da329fb5-be5f-4f95-a67a-3d49ae4e9496-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-ef604170-f836-4cf1-a141-9814dc14f809" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-ef604170-f836-4cf1-a141-9814dc14f809" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-da329fb5-be5f-4f95-a67a-3d49ae4e9496" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-da329fb5-be5f-4f95-a67a-3d49ae4e9496" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Deleting offline snapshot da329fb5-be5f-4f95-a67a-3d49ae4e9496 of volume ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] snapshot_file for this snap is: volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd3b429-3dbe-4069-a422-10897e52e0eb]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:36 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 Nov 06 21:38:36 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:36 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496" returned: 0 in 0.367s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef604170-f836-4cf1-a141-9814dc14f809(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58981ba-ae64-41ab-a8e7-7180fd911099]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:36 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 Nov 06 21:38:36 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:36 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809" returned: 0 in 0.416s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:36 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:36 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 Nov 06 21:38:36 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:37 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496" returned: 0 in 0.324s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:37 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496 Nov 06 21:38:37 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:37 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:37 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809.da329fb5-be5f-4f95-a67a-3d49ae4e9496" returned: 0 in 0.260s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-da329fb5-be5f-4f95-a67a-3d49ae4e9496" released by "_delete_snapshot" :: held 1.464s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-ef604170-f836-4cf1-a141-9814dc14f809" released by "delete_snapshot" :: held 1.484s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:37 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Created reservations ['138472c5-46ea-48c9-ac08-3d49afc3baf0', '01850e41-120e-436d-8737-3566423de2ad', 'a83cd910-e816-4d74-a54a-fe111af28592', '5faa5d2f-4d68-4ca1-9d8b-50865a94290d'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:37 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Delete snapshot completed successfully. Nov 06 21:38:37 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb00a8fd-0236-4623-b8ef-42b816566774 tempest-ProjectReaderTests-999922982 None] Lock "cinder-da329fb5-be5f-4f95-a67a-3d49ae4e9496-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-ef604170-f836-4cf1-a141-9814dc14f809-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Lock "cinder-ef604170-f836-4cf1-a141-9814dc14f809-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-ef604170-f836-4cf1-a141-9814dc14f809" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-ef604170-f836-4cf1-a141-9814dc14f809" acquired by "delete_volume" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb3d9e-18db-4abf-962c-9d1008946f27]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:38 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 Nov 06 21:38:38 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:38 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809" returned: 0 in 0.378s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:38 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809 Nov 06 21:38:38 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:38 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-ef604170-f836-4cf1-a141-9814dc14f809" returned: 0 in 0.240s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-ef604170-f836-4cf1-a141-9814dc14f809" released by "delete_volume" :: held 0.677s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:38 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Created reservations ['5f27f461-a907-419d-b2fa-eb8fa47890e9', '57bf19bb-c2c3-4b2d-ba43-7eed12997c56', '68f1e7ae-6bc5-4c63-bbbb-ebdc9f7f8ba6', 'ce0d238c-8a78-40cd-a945-c0378611aeb8'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:39 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:39 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:39 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.257s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:39 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Deleted volume successfully. Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-b8c82f64-9a9b-4892-813e-66273772e597 tempest-ProjectReaderTests-999922982 None] Lock "cinder-ef604170-f836-4cf1-a141-9814dc14f809-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (be08fa75-6db8-42d9-919f-08d1aa38fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bf4b54-dc87-4e12-9db1-32dfdd410145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bf4b54-dc87-4e12-9db1-32dfdd410145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100972501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c80cca-4921-43c2-a693-1f93296bb7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:40Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc0fe8b-8abb-4b67-9f76-79655b7963e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc0fe8b-8abb-4b67-9f76-79655b7963e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8455380c-bb5f-4075-a6cb-06352636e2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8455380c-bb5f-4075-a6cb-06352636e2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c80cca-4921-43c2-a693-1f93296bb7cc', 'volume_name': 'volume-c4c80cca-4921-43c2-a693-1f93296bb7cc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd60aef-5adf-4a93-84e5-0fc0907daf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd60aef-5adf-4a93-84e5-0fc0907daf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba28b823-72cc-4371-8a16-5f1318478a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:39 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Volume c4c80cca-4921-43c2-a693-1f93296bb7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c80cca-4921-43c2-a693-1f93296bb7cc', 'volume_size': 1} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100972501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c80cca-4921-43c2-a693-1f93296bb7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:40Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Creating volume c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:39 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:39 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:39 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc 1073741824 Nov 06 21:38:39 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:40 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc 1073741824" returned: 0 in 0.426s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:40 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc Nov 06 21:38:40 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:40 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc" returned: 0 in 0.249s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba28b823-72cc-4371-8a16-5f1318478a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c80cca-4921-43c2-a693-1f93296bb7cc', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02399a-c414-4f83-9a53-ab882b461c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:40 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Volume volume-c4c80cca-4921-43c2-a693-1f93296bb7cc (c4c80cca-4921-43c2-a693-1f93296bb7cc): created successfully Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02399a-c414-4f83-9a53-ab882b461c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (be08fa75-6db8-42d9-919f-08d1aa38fc60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:40 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-26327a8c-b554-4fcc-9a45-07c59be93c63 tempest-ProjectReaderTests-999922982 None] Created volume successfully. Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Creating offline snapshot b70d3ff4-b450-4536-89f9-b8a991e4b349 of volume c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe7f1c-8594-4d22-9a49-f7415a170343]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:40 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:41 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc Nov 06 21:38:41 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:41 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc" returned: 0 in 0.357s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:41 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 1G Nov 06 21:38:41 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:41 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 1G" returned: 0 in 0.423s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:41 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c80cca-4921-43c2-a693-1f93296bb7cc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:41 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c80cca-4921-43c2-a693-1f93296bb7cc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 Nov 06 21:38:41 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:42 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c80cca-4921-43c2-a693-1f93296bb7cc -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349" returned: 0 in 0.295s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:42 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 is being set with open permissions: ugo+rw Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:42 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 Nov 06 21:38:42 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:42 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349" returned: 0 in 0.234s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:42 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.info Nov 06 21:38:42 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:42 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.info" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:42 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.info is being set with open permissions: ugo+rw Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:42 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.info Nov 06 21:38:42 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:42 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.info" returned: 0 in 0.242s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:42 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:42 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-730fbe5d-fa0f-4a79-aa68-ad8834471933 tempest-ProjectReaderTests-999922982 None] Create snapshot completed successfully Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-b70d3ff4-b450-4536-89f9-b8a991e4b349-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Lock "cinder-b70d3ff4-b450-4536-89f9-b8a991e4b349-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-c4c80cca-4921-43c2-a693-1f93296bb7cc" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-c4c80cca-4921-43c2-a693-1f93296bb7cc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-b70d3ff4-b450-4536-89f9-b8a991e4b349" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-b70d3ff4-b450-4536-89f9-b8a991e4b349" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Deleting offline snapshot b70d3ff4-b450-4536-89f9-b8a991e4b349 of volume c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] snapshot_file for this snap is: volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf273b75-050c-4d81-97b1-84c7f28150b9]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:43 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 Nov 06 21:38:43 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:43 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349" returned: 0 in 0.368s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c80cca-4921-43c2-a693-1f93296bb7cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ea9d53-5914-4fdd-8772-e5086bc15644]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:43 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc Nov 06 21:38:43 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:43 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:43 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:43 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 Nov 06 21:38:43 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:44 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349" returned: 0 in 0.331s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:44 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349 Nov 06 21:38:44 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:44 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:44 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc.b70d3ff4-b450-4536-89f9-b8a991e4b349" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-b70d3ff4-b450-4536-89f9-b8a991e4b349" released by "_delete_snapshot" :: held 1.393s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-c4c80cca-4921-43c2-a693-1f93296bb7cc" released by "delete_snapshot" :: held 1.413s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:44 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Created reservations ['dcfc38c4-5d38-4bb6-8387-842d224773d1', '215df2b1-c5bf-4a46-a001-4c96faee856b', '4564a256-c55b-4b23-b70c-9b6f65d8b995', 'c1ea0e83-dfd8-4735-ac37-f39ac4191bfd'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:44 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Delete snapshot completed successfully. Nov 06 21:38:44 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-84289254-f0ab-402c-8bfa-85f61d76572f tempest-ProjectReaderTests-999922982 None] Lock "cinder-b70d3ff4-b450-4536-89f9-b8a991e4b349-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-c4c80cca-4921-43c2-a693-1f93296bb7cc-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Lock "cinder-c4c80cca-4921-43c2-a693-1f93296bb7cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-c4c80cca-4921-43c2-a693-1f93296bb7cc" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-c4c80cca-4921-43c2-a693-1f93296bb7cc" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[1985df84-f990-42ef-96b0-e423bb4782d5]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:45 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc Nov 06 21:38:45 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:45 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc" returned: 0 in 0.375s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:45 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc Nov 06 21:38:45 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:45 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-c4c80cca-4921-43c2-a693-1f93296bb7cc" returned: 0 in 0.244s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:45 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-c4c80cca-4921-43c2-a693-1f93296bb7cc" released by "delete_volume" :: held 0.680s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Created reservations ['74519b20-bb2d-4a77-ab3e-0178ae0e29b0', 'ed3e1881-ee95-41ff-bc3e-a33c981f7771', 'a85f5d74-3a24-4923-b127-dd472f85ba6d', '6ce2084f-ceea-4c9f-bfb8-ad1346b96837'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:46 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:46 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:46 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.259s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:46 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Deleted volume successfully. Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-1c9f7ca1-9deb-4be1-9e9b-7d854a89dbe4 tempest-ProjectReaderTests-999922982 None] Lock "cinder-c4c80cca-4921-43c2-a693-1f93296bb7cc-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (1fc9dcb2-f8f4-48f7-b812-45830ae05baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a0acdb-0558-47f6-9c0f-5d6fe1ba90be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a0acdb-0558-47f6-9c0f-5d6fe1ba90be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069855865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaa3915-d6ce-451a-9716-c00562ea51e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:47Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2306924d-ed3f-4742-999a-dc4c73a8d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2306924d-ed3f-4742-999a-dc4c73a8d710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26f2740-0d50-4b55-84d2-630bc93de728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26f2740-0d50-4b55-84d2-630bc93de728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdaa3915-d6ce-451a-9716-c00562ea51e5', 'volume_name': 'volume-cdaa3915-d6ce-451a-9716-c00562ea51e5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767bb501-a2d9-4206-bb21-dd82219e4bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767bb501-a2d9-4206-bb21-dd82219e4bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0152f145-23a1-494a-826e-0598e2a8fd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Volume cdaa3915-d6ce-451a-9716-c00562ea51e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdaa3915-d6ce-451a-9716-c00562ea51e5', 'volume_size': 1} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069855865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaa3915-d6ce-451a-9716-c00562ea51e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:47Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Creating volume cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:46 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:46 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:46 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 1073741824 Nov 06 21:38:46 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:47 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 1073741824" returned: 0 in 0.414s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:47 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 Nov 06 21:38:47 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:47 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5" returned: 0 in 0.252s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0152f145-23a1-494a-826e-0598e2a8fd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdaa3915-d6ce-451a-9716-c00562ea51e5', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2513522e-dd1d-45f2-a50c-2364950f9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:47 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Volume volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 (cdaa3915-d6ce-451a-9716-c00562ea51e5): created successfully Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2513522e-dd1d-45f2-a50c-2364950f9542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:47 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (1fc9dcb2-f8f4-48f7-b812-45830ae05baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:47 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-1488ca53-84f7-4fab-b815-96247cd9450c tempest-ProjectReaderTests-999922982 None] Created volume successfully. Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Creating offline snapshot aa218455-d920-4179-9d2b-755b1234715e of volume cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[af59437c-1289-4a20-b8aa-3f36bcd87311]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:48 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 Nov 06 21:38:48 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:48 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5" returned: 0 in 0.362s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:48 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e 1G Nov 06 21:38:48 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:48 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e 1G" returned: 0 in 0.437s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:48 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:48 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e Nov 06 21:38:48 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:49 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e" returned: 0 in 0.316s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:49 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e is being set with open permissions: ugo+rw Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:49 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e Nov 06 21:38:49 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:49 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e" returned: 0 in 0.257s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:49 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.info Nov 06 21:38:49 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:49 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.info" returned: 0 in 0.266s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:49 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.info is being set with open permissions: ugo+rw Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:49 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.info Nov 06 21:38:49 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:49 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.info" returned: 0 in 0.241s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:49 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:50 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-76537932-62c9-4336-9227-803198dd4ca6 tempest-ProjectReaderTests-999922982 None] Create snapshot completed successfully Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-aa218455-d920-4179-9d2b-755b1234715e-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Lock "cinder-aa218455-d920-4179-9d2b-755b1234715e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-cdaa3915-d6ce-451a-9716-c00562ea51e5" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-cdaa3915-d6ce-451a-9716-c00562ea51e5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-aa218455-d920-4179-9d2b-755b1234715e" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-aa218455-d920-4179-9d2b-755b1234715e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Deleting offline snapshot aa218455-d920-4179-9d2b-755b1234715e of volume cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] snapshot_file for this snap is: volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d077ba-c4ad-410f-a482-8834534834b7]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:50 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e Nov 06 21:38:50 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:50 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e" returned: 0 in 0.372s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdaa3915-d6ce-451a-9716-c00562ea51e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[86114c63-6b3f-433c-b50c-cf4c6d679a09]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:50 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:50 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 Nov 06 21:38:50 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:51 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5" returned: 0 in 0.360s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:51 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e Nov 06 21:38:51 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:51 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e" returned: 0 in 0.347s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:51 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e Nov 06 21:38:51 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:51 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5.aa218455-d920-4179-9d2b-755b1234715e" returned: 0 in 0.244s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-aa218455-d920-4179-9d2b-755b1234715e" released by "_delete_snapshot" :: held 1.425s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-cdaa3915-d6ce-451a-9716-c00562ea51e5" released by "delete_snapshot" :: held 1.447s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Created reservations ['3d1f5a86-d96a-4aa1-af22-4f9c55da905c', 'c8e7581d-fe15-4e27-8ab1-ef043c40841c', 'c971fb63-c32b-4254-8f3a-9341ef7f6296', '0571225c-3e86-48ac-9508-0ed474db0f47'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:51 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Delete snapshot completed successfully. Nov 06 21:38:51 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-de34dfba-5a94-45ce-978f-d72b19046797 tempest-ProjectReaderTests-999922982 None] Lock "cinder-aa218455-d920-4179-9d2b-755b1234715e-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-cdaa3915-d6ce-451a-9716-c00562ea51e5-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Lock "cinder-cdaa3915-d6ce-451a-9716-c00562ea51e5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-cdaa3915-d6ce-451a-9716-c00562ea51e5" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-cdaa3915-d6ce-451a-9716-c00562ea51e5" acquired by "delete_volume" :: waited 0.017s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c1f140-f30a-4754-abf5-86fe3abc344e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:52 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 Nov 06 21:38:52 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:52 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5" returned: 0 in 0.365s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:52 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:52 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5 Nov 06 21:38:52 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:53 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-cdaa3915-d6ce-451a-9716-c00562ea51e5" returned: 0 in 0.247s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-cdaa3915-d6ce-451a-9716-c00562ea51e5" released by "delete_volume" :: held 0.673s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Created reservations ['9f94f68f-3c1b-440f-93c5-d195f48dd073', 'efc12ce0-db13-4412-8f19-a6b7d44a0b99', 'd3a35f93-d60c-4aa6-9114-1285c0a3549e', '5fddbfa7-4f88-48e4-83af-21353fc6a9d1'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:53 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:38:53 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:53 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.248s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:53 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Deleted volume successfully. Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-fb210c4c-424f-4fe4-99b1-d7f4da2738c7 tempest-ProjectReaderTests-999922982 None] Lock "cinder-cdaa3915-d6ce-451a-9716-c00562ea51e5-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.flows.manager.create_volume [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87450) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (8c8e5be9-b25b-49d0-81db-086a72faaccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99d2d28-10dc-48c0-b043-9fb2306715a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99d2d28-10dc-48c0-b043-9fb2306715a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246235544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a48f5f6-37c3-489c-aa26-558d956c5a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:54Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dbf9a1-2f60-48b2-a9f7-c46a7770d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:53 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dbf9a1-2f60-48b2-a9f7-c46a7770d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02034c8b-5169-455f-8157-9f36d98114b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02034c8b-5169-455f-8157-9f36d98114b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a48f5f6-37c3-489c-aa26-558d956c5a88', 'volume_name': 'volume-3a48f5f6-37c3-489c-aa26-558d956c5a88', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87421d8b-e63f-444a-a62c-4dcf61873123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87421d8b-e63f-444a-a62c-4dcf61873123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017235ff-0117-4c40-9f26-b8ba8e516607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:54 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Volume 3a48f5f6-37c3-489c-aa26-558d956c5a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a48f5f6-37c3-489c-aa26-558d956c5a88', 'volume_size': 1} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246235544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a48f5f6-37c3-489c-aa26-558d956c5a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd517627c954d368dca8afafff8e7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:54Z,use_quota=True,user_id='9297cd69b7f247e892e102d34c22a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58b496f-3b03-4b30-a306-1100a1b490a5),volume_type_id=f58b496f-3b03-4b30-a306-1100a1b490a5)}" {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Creating volume 3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Selected osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a as target Quobyte volume. {{(pid=87450) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:54 devstack cinder-volume[87450]: INFO cinder.volume.drivers.remotefs [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] casted to osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 1073741824 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:54 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 1073741824 Nov 06 21:38:54 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:54 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 1073741824" returned: 0 in 0.407s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:54 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 Nov 06 21:38:54 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:54 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88" returned: 0 in 0.245s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'} {{(pid=87450) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017235ff-0117-4c40-9f26-b8ba8e516607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a48f5f6-37c3-489c-aa26-558d956c5a88', 'volume_size': 1}' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6068de-804b-4030-b650-5cb36a08895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:54 devstack cinder-volume[87450]: INFO cinder.volume.flows.manager.create_volume [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Volume volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 (3a48f5f6-37c3-489c-aa26-558d956c5a88): created successfully Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6068de-804b-4030-b650-5cb36a08895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87450) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:54 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Flow 'volume_create_manager' (8c8e5be9-b25b-49d0-81db-086a72faaccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87450) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:54 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-01952571-7f82-46df-a850-7e74ff9b3f00 tempest-ProjectReaderTests-999922982 None] Created volume successfully. Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Creating offline snapshot b23a1ea6-dd53-476a-9440-d0d700b97d6e of volume 3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6df352-a28c-4196-8cd2-011b23ed677c]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:55 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 Nov 06 21:38:55 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:55 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88" returned: 0 in 0.376s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e 1G {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:55 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e 1G Nov 06 21:38:55 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:55 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e 1G" returned: 0 in 0.413s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:55 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:55 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e Nov 06 21:38:55 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:56 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 -F qcow2 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e" returned: 0 in 0.285s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:56 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e is being set with open permissions: ugo+rw Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:56 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e Nov 06 21:38:56 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:56 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e" returned: 0 in 0.237s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:56 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.info Nov 06 21:38:56 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:56 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.info" returned: 0 in 0.241s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:56 devstack cinder-volume[87450]: WARNING cinder.volume.drivers.remotefs [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.info is being set with open permissions: ugo+rw Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.info {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:56 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.info Nov 06 21:38:56 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:56 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.info" returned: 0 in 0.236s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:56 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:57 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-e9bbad4e-33f4-4d6d-8d29-37bff18880e3 tempest-ProjectReaderTests-999922982 None] Create snapshot completed successfully Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-b23a1ea6-dd53-476a-9440-d0d700b97d6e-delete_snapshot" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Lock "cinder-b23a1ea6-dd53-476a-9440-d0d700b97d6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-3a48f5f6-37c3-489c-aa26-558d956c5a88" by "delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-3a48f5f6-37c3-489c-aa26-558d956c5a88" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-b23a1ea6-dd53-476a-9440-d0d700b97d6e" by "_delete_snapshot" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-b23a1ea6-dd53-476a-9440-d0d700b97d6e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Deleting offline snapshot b23a1ea6-dd53-476a-9440-d0d700b97d6e of volume 3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] snapshot_file for this snap is: volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e {{(pid=87450) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0decb8-53ff-4a65-a700-fab251906b7e]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:57 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e Nov 06 21:38:57 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:57 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e" returned: 0 in 0.353s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.remotefs [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a48f5f6-37c3-489c-aa26-558d956c5a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87450) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c027a8-1566-46bc-9c73-ff4b9e5b01b6]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:57 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:57 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 Nov 06 21:38:57 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:58 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88" returned: 0 in 0.353s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:58 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e Nov 06 21:38:58 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:58 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e" returned: 0 in 0.355s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:58 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e Nov 06 21:38:58 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:58 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88.b23a1ea6-dd53-476a-9440-d0d700b97d6e" returned: 0 in 0.255s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-b23a1ea6-dd53-476a-9440-d0d700b97d6e" released by "_delete_snapshot" :: held 1.411s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-3a48f5f6-37c3-489c-aa26-558d956c5a88" released by "delete_snapshot" :: held 1.431s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Created reservations ['41581b8c-a42c-4d27-8098-29275d23a896', '8dba2461-5b26-4218-94c0-adb0ee95e2a3', '6c13a8a0-74c4-4a7e-a1cd-e666bb5d370f', 'ddd08932-796b-413c-935c-17ae445e86a5'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:58 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Delete snapshot completed successfully. Nov 06 21:38:58 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-56ac818e-0c6e-4577-95c0-3e03d9c2b254 tempest-ProjectReaderTests-999922982 None] Lock "cinder-b23a1ea6-dd53-476a-9440-d0d700b97d6e-delete_snapshot" released by "delete_snapshot" :: held 1.564s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-3a48f5f6-37c3-489c-aa26-558d956c5a88-delete_volume" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-3a48f5f6-37c3-489c-aa26-558d956c5a88-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Acquiring lock "cinder-quobyte-3a48f5f6-37c3-489c-aa26-558d956c5a88" by "delete_volume" {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-3a48f5f6-37c3-489c-aa26-558d956c5a88" acquired by "delete_volume" :: waited 0.013s {{(pid=87450) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG oslo.privsep.daemon [-] privsep: reply[4865679f-5723-46dd-9bb9-2a26e2a7114b]: (4, 'qcow2') {{(pid=88576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:59 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 Nov 06 21:38:59 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:59 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88" returned: 0 in 0.350s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:59 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:59 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88 Nov 06 21:38:59 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:39:00 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384/volume-3a48f5f6-37c3-489c-aa26-558d956c5a88" returned: 0 in 0.252s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-quobyte-3a48f5f6-37c3-489c-aa26-558d956c5a88" released by "delete_volume" :: held 0.664s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG cinder.quota [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Created reservations ['cf5be3ab-b012-4ed3-9c36-2c88dd76656e', 'fac9b837-c9ef-4e32-ba87-7597a684c478', 'd159e311-6732-4bae-a2dc-8b9aa3345a5c', '41fb0bca-558d-4db3-8a1f-b3934ffed83e'] {{(pid=87450) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:39:00 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:39:00 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:39:00 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.256s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:39:00 devstack cinder-volume[87450]: INFO cinder.volume.manager [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Deleted volume successfully. Nov 06 21:39:00 devstack cinder-volume[87450]: DEBUG cinder.coordination [None req-63f83867-6115-48d5-9afd-f9be83afc6e1 tempest-ProjectReaderTests-999922982 None] Lock "cinder-3a48f5f6-37c3-489c-aa26-558d956c5a88-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87450) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:39:10 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=113,cinder:DELETE=9,cinder:INSERT=35,cinder:UPDATE=143 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:39:10 devstack cinder-volume[87450]: DEBUG dbcounter [-] [87450] Writing DB stats cinder:SELECT=104,cinder:INSERT=43,cinder:UPDATE=137,cinder:DELETE=14 {{(pid=87450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a': None} {{(pid=87450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG cinder.volume.drivers.quobyte [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1787d14-fcdc-4500-a929-c8369afc895a'] {{(pid=87450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.lockutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:39:11 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384 Nov 06 21:39:11 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:39:11 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG oslo_concurrency.processutils [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13ea55f29e36d58099a91c1c3fe9a384" returned: 0 in 0.257s {{(pid=87450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG cinder.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Notifying Schedulers of capabilities ... {{(pid=87450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG oslo_service.periodic_task [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] Running periodic task VolumeManager._thread_info {{(pid=87450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread count: 28 {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:39:11 devstack cinder-volume[87450]: DEBUG cinder.volume.manager [None req-c9321f02-4d27-4c37-821c-b3e752699b94 None None] thread info: [<_MainThread(MainThread, started 135496701190272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}